Lead Consultant - Quality Engineering (Azure AI)

TL;DR

Lead Consultant - Quality Engineering (Azure AI): Leading testing activities including automation, performance, data quality, and AI model validation for client projects with an accent on comprehensive test strategies, defect management, and LLM behavior testing. Focus on designing test plans for data pipelines and machine learning models, ensuring high coverage and alignment with Azure-based solutions.

Remote in Philippines. We cannot sponsor work visas.

Company

Microsoft Azure-focused consulting firm with global partnerships and a pipeline of cutting-edge cloud projects.

What you will do

• Apply QE knowledge in automation, performance, data quality, and AI testing to define test planning and advise teams.
• Drive delivery through manual and automated testing across functional, system, data, and AI components.
• Lead design and implementation of test strategies, processes, and documentation for projects.
• Maintain test records, share feedback, and lead defect triage.
• Develop and validate test data, pipelines, and infrastructure.
• Evaluate machine learning models, LLM prompts, outputs, and performance metrics.
• Mentor juniors and promote QE best practices.

Requirements

• Bachelor’s degree in computer science or related field.
• Extensive QA experience in methodologies, test planning, automation, and quality engineering.
• Proficiency in automation tools like Selenium, Playwright.
• Programming skills in Python, C#, Java.
• Experience testing data pipelines, ETL, analytics platforms (Databricks, Fabric preferred).
• Understanding of ML principles, model evaluation, AI/LLM testing.
• Strong analytical, problem-solving, communication skills; client-facing experience.

Nice to have

• Azure or Microsoft certifications.
• Cloud platforms experience, especially Azure.
• Agile certifications.

Culture & Benefits

• Flexible work location with great company culture.
• Competitive compensation, allowances, performance bonuses.
• Environment encouraging experimentation, candid feedback, and accountability to core values.
• Opportunities for growth in Azure technologies.