Java QA Automation Engineer (Banking)

TL;DR

Java QA Automation Engineer (Java/Playwright): Building API and E2E test coverage for banking systems with an accent on LLM evaluation and quality gates. Focus on implementing non-deterministic output validation, integration of LLM tooling, and optimizing CI/CD pipelines.

Location: Remote (Romania)

Company

hirify.global is an IT consulting firm with 25 years of experience providing scalable enterprise systems and digital transformation platforms globally.

What you will do

• Build API and integration test coverage for Java/Spring routers and database workflows.
• Design and implement Playwright E2E tests for critical user journeys.
• Establish LLM evaluation disciplines using golden datasets and measurable quality gates.
• Implement LLM QA tooling using LangChain4j, Langfuse, and OpenAI Java SDK.
• Set up CI quality gates for linting, testing, coverage, and reporting.
• Track model output reliability, detect drift, and optimize test runtime.

Requirements

• 3+ years of experience in QA automation for production systems.
• Strong Java backend and frontend testing skills.
• Experience with Playwright, Cypress, or Selenium E2E suites.
• Proficiency in API testing (REST, schema validation) and SQL/PostgreSQL.
• Experience with CI/CD pipelines (GitHub Actions, Azure Pipelines, or Jenkins).
• Practical understanding of testing non-deterministic LLM outputs.

Nice to have

• Experience with Promptfoo, Langfuse, or OpenTelemetry.
• Performance and benchmark testing experience.
• WebSocket testing and security scanning awareness.
• Experience in fintech, legal-tech, or other regulated domains.

Culture & Benefits

• Premium medical package, lunch tickets, and Pluxee card.
• 13th salary and yearly bonuses.
• Access to leading learning platforms (Pluralsight, Udemy) and certifications.
• Flexible working program and openness to remote work.
• Supportive culture valuing ownership, autonomy, and work-life balance.