Senior SDET (AI)

TL;DR

Senior SDET (AI): Designing and building automated quality infrastructure for high-growth technology platforms with an accent on scalable E2E, integration, and API testing frameworks. Focus on developing evaluation systems for AI/LLM-powered applications, integrating CI/CD pipelines, and driving engineering excellence across distributed teams.

Location: 100% Remote

Company

hirify.global is a leading nearshore staff augmentation provider connecting highly skilled Latin American tech professionals with innovative U.S. companies.

What you will do

• Design and build scalable E2E, integration, and API testing frameworks from scratch.
• Develop testing and evaluation systems for AI/LLM-powered applications, including agentic workflows and RAG systems.
• Integrate automated testing into CI/CD pipelines to support rapid deployment.
• Create automated guardrails, confidence metrics, and regression detection for non-deterministic AI systems.
• Collaborate with software engineers to improve testability and establish quality standards.
• Monitor application quality in production using observability and analytics tools.

Requirements

• Senior-level experience as an SDET or Test Automation Engineer.
• Strong proficiency in TypeScript and Node.js.
• Proven ability to design and build testing frameworks from scratch.
• Extensive experience testing REST and GraphQL APIs, including authentication flows.
• Practical experience with AI-assisted development tools like Cursor, Claude Code, or GitHub Copilot.
• Experience working independently in remote, async-first environments.

Nice to have

• Experience testing AI/LLM applications (prompt evaluation, hallucination detection, RAG).
• Familiarity with LangSmith, Braintrust, or custom AI evaluation frameworks.
• Experience with AWS or Azure.
• Knowledge of observability, production monitoring, and quality metrics.
• Familiarity with event-driven architectures and distributed systems.

Culture & Benefits

• Highly competitive USD compensation.
• 100% remote work with autonomy and results-oriented culture.
• Paid time off policies.
• Opportunity to work with top-tier U.S. companies on high-impact projects.
• Collaborative environment with a diverse, global network of 600+ senior professionals.