Engineering Manager (AI)

TL;DR

Engineering Manager (AI): Spearheading the quality of AI application development at hirify.global with an accent on ensuring relevancy, consistency, reliability, contextual recall and fairness of our AI platform. Focus on model validation, agentic workflows, and quality leadership.

Location: Remote

Company

hirify.global is an AI-powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth.

What you will do

• Review testing strategies for AI applications and fine-tune strategy to minimize issues in production.
• Establish evaluation pipelines for detecting hallucination, context retention, and latency in multi-model environments.
• Implement A/B testing at appropriate levels to identify customer impact.
• Run down defect triaging for all customer issues to identify root cause and expand test coverage to mitigate gaps.
• Ensure quality deliverables from AI teams.
• Hire top talent and mentor SDET team on AI testing skills.

Requirements

• Overall 8-12 years of experience in which minimum of 1 year in testing AI products
• Good experience in Prompt Engineering, testing AI applications like conversations AI, voice AI, and workflow AI
• Architect and scale test automation frameworks for APIs, micro-services, ML pipelines, and agentic AI workflows
• Experience in testing RAG-based applications using frameworks like TruLens, RAGAs
• Strong programming skills in Python and Java or TypeScript/JavaScript
• Proven expertise in test automation frameworks (Selenium, Playwright, Cypress etc.)
• Experience with cloud platforms (AWS, GCP) and CI/CD pipelines

Culture & Benefits

• Global, remote-first environment.
• Cultivating a culture where innovation thrives, ideas are celebrated, and people come first, no matter where they call home.