Staff Software Engineer – Testing & Evals Frameworks (AI)

Location: On-site five days per week in McLean, Virginia, or Mountain View, California, United States.

Annual base salary: $174,000–$229,000 USD for the U.S.; $194,000–$253,000 USD for Mountain View, California.

Company

hirify.global develops a digital identity wallet and authentication platform used by consumers, government agencies, healthcare organizations, and consumer brands.

What you will do

• Own the architecture and long-term strategy for testing infrastructure and automation frameworks using Playwright, Python, Jest, and API automation.
• Define end-to-end and integration testing for asynchronous, event-driven, eventually consistent systems and workflow orchestration platforms such as Temporal.
• Establish testing-in-production practices, including canary deployments, progressive rollouts, synthetic monitoring, and automated rollback triggers.
• Set standards for security-focused testing of OAuth 2.0, OIDC, RBAC/ReBAC, secrets management, and tenant isolation.
• Integrate automated tests into organization-wide CI/CD pipelines and build evaluation pipelines for AI-assisted features and LLM agents.
• Advise engineering, product, platform, and security teams; mentor engineers; debug issues; and define reliability, quality, and evaluation metrics.

Requirements

• 10+ years of experience as a software engineer in modern web applications and distributed systems, or 10+ years with a Master's degree or 5+ years with a PhD.
• Proficiency in Python, TypeScript, JavaScript, and Java.
• Hands-on experience with Playwright, Jest, API automation, or software/AI evaluation frameworks.
• Experience integrating automated tests into CI/CD pipelines such as GitHub Actions or ArgoCD.
• Ability to lead cross-team technical initiatives and influence engineering standards.
• Track record of mentoring senior engineers and raising quality standards across teams.
• Strong written and verbal communication across engineering, product, and leadership.

Nice to have

• Experience with REST APIs, microservices, distributed and event-driven architectures, and Temporal.
• Experience with identity and access management, including OAuth 2.0, OIDC, SAML 2.0, SCIM 2.0, enterprise identity providers, RBAC/ReBAC, and multi-tenant authorization.
• Experience with security and compliance testing, identity verification, KYC, PII, secrets management, and tenant isolation.
• Experience with canary rollouts, contract testing, automated rollback, performance/load testing, observability, or chaos engineering.
• Experience with Java/Spring Boot or Ruby on Rails, GCP, Docker, and Kubernetes.
• Experience building AI-agent evaluation frameworks, agentic testing tools, RAG pipelines, production monitoring, red-teaming, or adversarial testing.
• Experience in identity verification, fraud detection, regulated industries, Datadog, or OpenTelemetry.

Culture & Benefits

• Full-time, in-office work five days per week at an hirify.global office.
• Medical, dental, vision, HSA, FSA, life, disability, accident, and critical illness insurance.
• 401(k) with company match, parental leave, unlimited paid time off subject to policy, and eight company-wide holidays.
• Learning and development benefit, employee assistance program, pet insurance, commuter benefits, wellbeing and childcare discounts, and travel assistance.
• AI tools may be used thoughtfully in daily work and hiring, subject to hirify.global's interview and application guidelines.