обновлено 8 часов назад
AI Software Developer in Test - Vice President
120 000 - 150 000$
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI Software Developer in Test - Vice President (AI/ML and Backend QA): Building automated test suites and evaluation frameworks for APIs, backend services, AI/ML models, and blockchain-based components with an accent on model validation, prompt behavior, regression analysis, and CI/CD integration. Focus on detecting hallucinations, bias, drift, and non-deterministic behavior while designing performance tests and quality metrics for distributed systems.
Location: Salt Lake City, Utah, United States; office work Monday–Thursday with remote work available on Friday
Salary: $120,000–$150,000 per year, plus equity and an annual performance bonus
Company
develops and operates a financial technology platform.
What you will do
- Build robust automated test suites for APIs, backend services, microservices, distributed systems, and smart contract interactions.
- Design AI/ML and LLM testing strategies covering model outputs, prompt behavior, determinism, regression, accuracy, consistency, hallucinations, bias, and drift.
- Create automated AI evaluation frameworks and integrate test suites into GitLab CI/CD pipelines and deployment workflows.
- Partner with AI/ML engineers, platform teams, developers, product managers, DevOps engineers, and governance stakeholders on testability, traceability, and production readiness.
- Maintain automation frameworks, defect workflows, QA metrics, and performance and load testing suites.
- Improve QA processes, tooling, and engineering practices within an Agile environment.
Requirements
- 10+ years of QA engineering delivery experience, with a strong focus on backend or API testing.
- 6+ years working in Agile SDLC teams, ideally with CI/CD.
- Experience testing AI/ML or LLM-powered systems, including model validation, prompt testing, regression testing, and evaluation of non-deterministic outputs.
- Strong experience with REST APIs, backend microservices, and distributed systems.
- Experience with Python, Behave, PyTest, Postman or REST tools, JMeter or similar performance tools, GitLab, Git, Jenkins, and Docker.
- Understanding of CI/CD pipelines, especially GitLab CI/CD.
Nice to have
- Experience with blockchain technologies, smart contracts, distributed ledgers, or blockchain node interaction.
- AI integration experience.
- Exposure to banking or finance environments.
Culture & Benefits
- Hybrid schedule with four days in the office and remote work on Fridays.
- Comprehensive benefits package with an employer-matched retirement plan.
- Subsidized healthcare with employer-paid dental, vision, telemedicine, and virtual mental health counseling.
- Parental leave and unlimited paid time off.
- Equity for all full-time employees and an annual performance bonus.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →