Senior Data Quality Engineer (Databricks)

Location: Remote or hybrid in Kazakhstan; office access is available in Almaty, Astana, or Karaganda. Relocation opportunities are available within EPAM offices in 55+ countries.

Company

EPAM provides custom software, product, platform engineering, and AI transformation services for enterprises and startups.

What you will do

• Design, build, and maintain automated testing solutions for data pipelines, APIs, and platform components.
• Validate data quality, transformations, and pipeline outputs using SQL and Python.
• Maintain test automation frameworks in an Azure-based ecosystem, including Databricks and big data platforms.
• Integrate automated tests into CI/CD pipelines and collaborate with Data Engineering, Platform Engineering, and DevOps teams.
• Monitor, log, and troubleshoot pipeline failures while supporting ETL/ELT maintenance and optimization.
• Contribute to testing across the Data Product Engineering Framework, Polarmesh Portal, and Platform Engineering Team.

Requirements

• 5+ years of experience as a QA Engineer or Test Automation Engineer in data engineering or data platform environments.
• Strong hands-on experience with Azure cloud services and Azure Databricks, Spark/PySpark, or similar platforms.
• Experience testing data quality, transformations, and pipeline outputs with SQL and/or Python.
• Understanding of data pipelines, ETL/ELT processes, monitoring, logging, and troubleshooting.
• Experience with CI/CD tools such as Azure DevOps or GitHub Actions, plus version control with GitHub.
• Ability to collaborate with Data Engineers, Platform Engineers, and DevOps teams on testing strategy.

Nice to have

• Experience with Delta Lake, Azure Data Factory, ADLS, Synapse, or Event Hub.
• Knowledge of Terraform or ARM/Bicep and data quality tools or frameworks.
• Basic understanding of Docker, Kubernetes, or containerized environments.
• Experience working in Agile/Scrum teams.

Culture & Benefits

• Option to work from home or from an EPAM office, with an opportunity to work abroad for up to two months per year.
• Relocation opportunities across EPAM offices in 55+ countries.
• Leadership development, career advising, soft-skills, and well-being programs.
• Certifications, access to EPAM's internal learning database, and free English classes.
• Employee Stock Purchase Plan, medical and family care package, six trust days, psychology session coverage, and other benefits.
• Housing support through preferential mortgage access via the Otbasy Bank partnership.