Senior Data Quality Engineer, SDET with Databricks and Microsoft Fabric

Location: Bulgaria, Cyprus, Latvia, Poland, or Romania

Company

hirify.global is hiring for a project with a UK financial services group operating in a highly regulated environment.

What you will do

• Design and implement data testing and quality assurance frameworks.
• Build automated validation for data pipelines and data products, including pipeline checks, business rule assertions, and repeatable regression packs.
• Own source-to-target reconciliation between legacy systems and the Databricks and Microsoft Fabric platform using defined tolerances.
• Write automated unit tests within CI/CD and implement quality gates that can block releases.
• Detect schema drift and unexpected structural changes.
• Validate reports, dashboards, and semantic models, including measure definitions, filter behaviour, and totals.

Requirements

• 5+ years of experience in quality engineering, with meaningful recent experience testing data or ETL processes rather than applications.
• Strong Python and SQL skills used for building test automation.
• Experience with pipeline validation, including row counts, control totals, referential integrity, and business rule assertions.
• Experience with source-to-target reconciliation using defined tolerances.
• Experience with test automation within CI/CD, including gates that block a release.
• Experience with Azure DevOps and SQL Server.
• English proficiency suitable for direct client conversations.

Nice to have

• Experience with Azure Databricks or Microsoft Fabric.
• Experience with data quality frameworks such as Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, or Deequ.
• Experience designing a test framework from scratch rather than extending an existing one.
• Experience testing semantic models and BI layers.
• Experience working in a regulated financial services environment.
• Experience with application test automation alongside data testing, including Selenium, C#, SpecFlow, or Playwright.

Culture & Benefits

• Work on a platform modernisation programme for a regulated UK financial services group.
• Contribute to a migration from a legacy data and reporting estate to Databricks and Microsoft Fabric.
• Apply AI-assisted techniques to test generation and coverage analysis with human review.

Hiring process

• Apply for the job through the vacancy process.