Sr. Quality Assurance Engineer, AWS Quick Desktop (AI)

TL;DR

Sr. Quality Assurance Engineer (AI): Designing and driving the end-to-end quality strategy for an AI-powered desktop work companion across multiple platforms with an accent on test automation frameworks and AI evaluation systems. Focus on developing evaluation frameworks for LLM-based agent workflows, ensuring reliability of connector integrations, and establishing comprehensive quality metrics.

Location: USA, WA, Seattle

Salary: $133,300 - $180,300

Company

hirify.global AI is building an AI-native desktop product that integrates various digital tools into a unified experience for knowledge workers.

What you will do

• Define and drive the end-to-end quality strategy across macOS, Windows, iOS, Android, and web platforms.
• Architect scalable, reusable automation infrastructure for Electron-based desktop apps and API integrations.
• Develop evaluation frameworks for LLM-based agent workflows, focusing on correctness, latency, and hallucination detection.
• Establish and track comprehensive quality metrics and dashboards to drive data-informed decisions.
• Design test harnesses and contract tests for third-party connectors including Slack, Outlook, and Teams.
• Mentor QAEs and SDETs while fostering a culture of quality ownership across engineering teams.

Requirements

• 6+ years of quality assurance engineering experience.
• 4+ years of experience delivering test frameworks, test tools, and leading QA initiatives.
• Strong expertise in both automation and manual testing methodologies.
• Must be based in or authorized to work in Seattle, WA, USA.

Nice to have

• 2+ years of UI Automation experience, preferably on mobile platforms.
• Knowledge of modern object-oriented programming languages such as C++, Java, or Objective C.

Culture & Benefits

• Comprehensive health insurance including medical, dental, vision, and prescription coverage.
• Financial benefits including 401(k) matching, sign-on payments, and Restricted Stock Units (RSUs).
• Paid time off and parental leave.
• Support systems including EAP, Mental Health Support, and Medical Advice Line.
• High-ownership environment operating similarly to a startup within a large organization.