Machine Learning Evaluation Engineer (AI)

Machine Learning Evaluation Engineer (Agentic Mobile App Generator)
#офис
Cyprus
Company: JetBrains
☑️In this role, you will:
-Design, build, and maintain evaluation pipelines.
-Work with AI engineers, mobile experts, and product designers to establish quality standards and test plans.
-Develop ways to assess the completeness, security, and performance of generated apps.
-Analyze evaluation results, identify areas to improve code generation, and give feedback to the development team.
-Develop and run test plans, test cases, and automated tests.
-Improve our testing methods and QA processes in an agile environment.
-Join discussions, design reviews, and brainstorming sessions around AI tools.

☑️We'd like you to join the team if you:
-Have at least three years of QA or evaluation engineering experience in commercial software, with a strong background in testing complex systems.
-Have experience or interest in building and maintaining evaluation pipelines for AI-assisted development, prompt engineering, or ML-based code generation.
-Have experience with data analysis tools or ML experiment tracking platforms.
-Understand software testing methods, including functional, performance, and integration testing.
-Are proficient in Python, Kotlin, Java, Swift, or similar languages.
-Work well in distributed, cross-functional teams.
Have strong English communication skills and can explain complex ideas clearly.
Contact: Показать контакты

🔥 Подписаться на наши каналы / @best_itjob / @it_rab