Software Quality Engineer (AI)

TL;DR

Software Quality Engineer (AI): Defining and implementing comprehensive quality assurance strategies and test plans for AI agents and LLM-powered applications, ensuring exceptional product reliability and performance with an accent on designing and developing robust, scalable automated test frameworks. Focus on collaborating with machine learning engineers and data scientists to translate complex AI features into effective test cases, integrating automated checks within CI/CD pipelines, and monitoring AI model performance.

Location: Hybrid role based out of our San Francisco or New York City hubs. This position is for US full-time employees.

Salary: $119,600–$210,600

Company

hirify.global is an AI platform providing tools for enterprises to orchestrate AI-powered work, building and deploying AI agents grounded in company data.

What you will do

• Define and implement comprehensive quality assurance strategies and test plans for AI agents and LLM-powered applications.
• Design and develop robust, scalable, and maintainable automated test frameworks using languages like Typescript, Python, or Scala.
• Collaborate with product managers, machine learning engineers, and data scientists to translate AI features into effective test cases.
• Drive continuous improvement of testing processes and infrastructure, integrating automated checks within CI/CD pipelines.
• Identify, document, and track software defects, performing root cause analysis for development teams.
• Monitor production systems and AI model performance, contributing to post-release quality validation.

Requirements

• 5+ years of hands-on experience in software quality assurance or engineering, with a strong focus on testing complex distributed systems or AI/ML applications.
• Proficiency in programming languages like Python or Typescript for test automation.
• Experience with modern testing frameworks such as Playwright.
• Solid understanding of AI/ML concepts, including model evaluation metrics and data pipelines.
• Exceptional analytical skills to dissect complex problems and a keen eye for detail.
• English: B2 required.

Nice to have

• Experience with cloud platforms (AWS, Azure, GCP) and containerization technologies (Docker, Kubernetes) in a CI/CD environment.

Culture & Benefits

• Generous PTO and company holidays.
• Medical, dental, and vision coverage for employees and their families.
• Paid parental leave (12 weeks) and fertility/family planning support.
• Flexible spending accounts (FSA) and health savings accounts (HSA) with company contribution.
• Annual work-life stipends for wellness and learning & development.
• Company-wide and team off-sites.
• Competitive compensation, company stock options, and 401k.