Senior Test Engineer (AI)

Location: Budapest, Hungary; flexible office-based, remote, or hybrid work is available, but candidates must be Hungary-based.

Company

hirify.global develops AI-powered customer and employee experience technology, including the hirify.global Cloud Copilot agentic AI platform used by more than 8,000 organizations worldwide.

What you will do

• Design and execute test strategies for AI agents, tools, MCP integrations, and multi-step workflows.
• Build and maintain scalable Python test frameworks and automation with fast CI/CD feedback.
• Develop evaluation datasets, scoring methods, and quality metrics for non-deterministic AI behavior.
• Contribute standards, patterns, and tooling to cross-team test architecture initiatives.
• Pilot AI-assisted testing and development workflows and support their adoption across teams.
• Own testing projects end to end and communicate quality risks, results, and release recommendations to developers, product managers, architects, and leadership.

Requirements

• 5+ years of professional software testing or quality engineering experience with a proven delivery track record.
• Strong Python skills and hands-on experience building test frameworks and automation, such as pytest.
• Experience designing test strategies, test plans, and test cases for complex, distributed, or cloud-based systems.
• Experience testing APIs, services, and integrations in CI/CD pipelines.
• Familiarity with LLMs, AI agents, or MCP, with a strong interest in developing further expertise.
• Ability to work independently and manage projects end to end with minimal oversight.
• Excellent communication skills for explaining technical quality topics to technical and non-technical stakeholders.
• Comfort working in agile teams with frequent change and shifting priorities.
• Strong analytical and problem-solving skills with a curious, investigative mindset.

Nice to have

• Experience testing non-deterministic systems, including LLM applications, ML models, or probabilistic outputs.
• Experience with AI agent evaluation, eval frameworks, LLM-as-judge, benchmark design, DeepEval, Ragas, or LangSmith.
• Performance, load, or scalability testing experience with tools such as Locust, k6, or JMeter.
• Experience contributing to cross-team quality initiatives.
• Hands-on experience using AI-assisted development and testing tools.
• Experience with cloud platforms, preferably AWS, and containerized environments.
• Background in contact center, CX, or SaaS platforms.

Culture & Benefits

• Multinational-company stability combined with startup-like flexibility and speed.
• Open and inclusive community with support from global and local leaders.
• Professional development through mentorship, learning programs, leadership development, education support, and language courses.
• Flexible work options for Hungary-based employees, including long-term remote, hybrid, or office-based work in Budapest.
• Extra days off in August and October, paid volunteer time, and well-being resources.
• Cafeteria, health insurance, life insurance, gym, vitamin bar, company café, and Budapest headquarters near Nyugati Railway Station.

Hiring process

• Application review by the Talent Acquisition and hiring teams.
• Zoom interview followed by meetings with the hiring manager and interview team.
• Usually no more than five interviews, followed by final-step communication.