Senior QA Automation Engineer (Python, AI)

TL;DR

Senior QA Automation Engineer (Python, AI): Designing and implementing automated test solutions for an AI-powered conversational platform with an accent on REST API validation, UI automation, and real-time voice technologies. Focus on integrating automated tests into CI/CD pipelines, validating LLM-based interactions, and ensuring low-latency performance for voice-based AI solutions.

Location: Remote (Work From Anywhere) or Kyiv, Ukraine

Company

A global IT services and consulting company supporting digital transformation for some of the world's largest enterprises.

What you will do

• Design and maintain automated test solutions for REST APIs, covering authentication, RBAC, and request/response validation.
• Build and enhance UI automation frameworks using Playwright with TypeScript.
• Develop and maintain test automation scripts using Python and pytest.
• Integrate automated tests into CI/CD pipelines to ensure continuous quality validation.
• Validate conversational and voice-based AI solutions, focusing on user interactions and system responses.
• Support performance and latency validation for real-time communication workflows.

Requirements

• 5+ years of experience in QA, testing web applications and API-driven systems.
• Strong hands-on experience with REST API testing and tools like Postman.
• Proficiency in UI test automation using Playwright with TypeScript.
• Solid scripting skills using Python and pytest.
• Experience with AWS services (ECS, CloudWatch, Secrets Manager, S3).
• English: Strong written and verbal communication skills required.

Nice to have

• Experience testing AI/LLM, voice agents, or conversational automation systems.
• Background in SIP, WebRTC, LiveKit, or contact center/IVR testing.
• Knowledge of latency and performance validation (TTFT, response timing).
• SQL skills for test data validation.
• Understanding of Terraform or general cloud infrastructure concepts.

Culture & Benefits

• Work From Anywhere culture providing high flexibility.
• Comprehensive compensation package including health insurance.
• Relocation program available.
• Professional development opportunities, including certification programs and mentorship.
• Inclusive, multicultural environment with regular team-building and social events.