Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
развернуть
По международному рынку данных пока нет
На СНГ рынке: $3к/мес ($2к - $4.1к)
78
Хорошая вакансия
развернуть
Здесь много практической работы с тестированием AI-систем, но широкий охват задач и длинный список желательных навыков затрудняют понимание реального фокуса роли.
Широкий охват
Фокус на AI
Современный стек
Сильный пакет
Актуальный домен
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
AI - Software Development Engineer in Test (AI - SDET) (AI/LLM, Python, RAG): Designing and validating quality engineering strategies for AI-powered applications, agents, copilots, RAG pipelines, and scalable automation frameworks with an accent on AI evaluation, safety, observability, and reliability. Focus on building semantic validation pipelines, testing agentic workflows and tool integrations, and measuring latency, cost, throughput, and system resilience.
Location: Argentina — remote
Company
hirify.global is a web technology company serving nearly seven million customers through products and brands including Bluehost, HostGator, Web.com, and Register.com.
What you will do
Design, validate, and optimize testing strategies for AI applications, copilots, chatbots, RAG pipelines, and autonomous agents.
Build AI evaluation frameworks and automated LLM validation pipelines covering hallucinations, groundedness, toxicity, bias, response quality, safety, guardrails, consistency, and prompt regressions.
Create synthetic and benchmark datasets; test multi-agent orchestration, memory and context retention, MCP integrations, tool calling, structured outputs, and multimodal workflows.
Develop scalable Python-based UI and API automation frameworks and reusable libraries for REST, GraphQL, event-driven, streaming, webhook, microservice, and MFE systems.
Integrate automation into CI/CD quality gates and validate RAG architectures, vector search, embeddings, AI agents, cloud deployments, distributed systems, observability, reliability, and resiliency.
Collaborate with Engineering, AI/ML, Platform, Product, and DevOps teams on shift-left quality engineering and AI-native testing practices.
Requirements
Strong programming experience in Python.
Strong understanding of software testing and quality engineering principles.
Hands-on experience with AI/LLM testing, prompt engineering, context engineering, AI evaluations, RAG systems, and AI agents.
Experience with CI/CD pipelines, Docker and Kubernetes, cloud platforms including AWS, Azure, OCI, or GCP, API testing and automation, microservices testing, and UI automation.
Experience with SQL and data validation.
Strong debugging, analytical, and troubleshooting skills.
Experience working in Agile/Scrum environments.
Bachelor’s or Master’s degree in Computer Science, Engineering, AI/ML, or a related field is preferred; equivalent hands-on experience and demonstrable projects are valued.
Ability to learn emerging AI frameworks, tools, and architectures, with interest in AI experimentation, prototypes, side projects, or open-source contributions.
Experience with Cursor, GitHub Copilot, Claude, Gemini, OpenAI APIs, vector databases, embeddings, MLOps, and ML lifecycle testing.
Knowledge of performance, security, contract, chaos, resilience, accessibility, cross-browser/device, synthetic monitoring, and production observability testing.
Experience with AI governance and compliance, AI red teaming, prompt injection, jailbreaks, data leakage, agent safety, AI cost optimization, distributed systems testing, test data engineering, feature flags, telemetry, reinforcement learning feedback, human-in-the-loop evaluation, knowledge graphs, or multimodal AI testing.
Portfolio signals such as AI or automation repositories, personally or professionally built agents or copilots, open-source contributions, technical content, SDLC/QE AI integrations, autonomous testing, or self-healing automation.
Culture & Benefits
Remote work in Argentina; the company also supports hybrid and office-based environments.
Work-life balance, diversity and inclusion, belonging initiatives, and more than 20 affinity groups.
OSDE 310 healthcare, monthly salary reviews, tuition and internet reimbursement, in-company English lessons, LinkedIn Learning, referral bonus, extra days off, and annual bonus.
Opportunities to work on global projects with multicultural teams, learn across the business, receive mentorship, and grow professionally.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →