8 дней назад
Senior Data Quality Engineer, SDET with Databricks and Microsoft Fabric
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Quality Engineer, SDET with Databricks and Microsoft Fabric (data quality and financial services): Building automated validation, reconciliation, and quality gates for data pipelines and reporting products during a migration to Databricks and Microsoft Fabric with an accent on Python, SQL, CI/CD automation, and schema-drift detection. Focus on reconciling legacy and target systems, validating semantic models and dashboards, and applying AI-assisted test generation with human review.
Location: UK
Company
is a software engineering company delivering data, analytics, and AI solutions for clients across industries, including financial services.
What you will do
- Design and implement data testing and quality assurance frameworks.
- Build automated validation for data pipelines and data products using Python and SQL.
- Own source-to-target reconciliation between legacy systems and the modern Databricks and Microsoft Fabric platform.
- Create unattended regression packs and CI/CD unit tests with quality gates that can block releases.
- Detect schema drift and validate reports, dashboards, semantic models, measures, filters, and totals.
- Apply AI-assisted techniques to test generation and coverage analysis with human review.
Requirements
- 5+ years of quality engineering experience, including recent testing of data or ETL processes.
- Strong Python and SQL skills for building test automation.
- Experience with pipeline validation, row counts, control totals, referential integrity, business rule assertions, and source-to-target reconciliation.
- Experience with CI/CD test automation and release-blocking quality gates.
- Experience with Azure DevOps and SQL Server.
- English proficiency suitable for direct client conversations and work based in the UK.
Nice to have
- Experience with Azure Databricks, Microsoft Fabric, or data quality frameworks such as Great Expectations, dbt tests, Databricks Expectations, Soda, or Deequ.
- Experience designing test frameworks from scratch and testing semantic models or BI layers.
- Experience in regulated financial services.
- Application test automation experience with Selenium, C#, SpecFlow, or Playwright.
Culture & Benefits
- Vacation, sick pay, and state-holiday time off according to the laws and official calendar of the country.
- Health insurance support for employees and their loved ones.
- Flexible work formats are supported across the company, with equipment and secure access provided where applicable.
- Coverage for IT certifications and access to professional courses and learning platforms.
- Corporate events, technical support, mental health programs, and professional development resources.
Hiring process
- CV review followed by an HR interview.
- Communication and technical assessments covering English and relevant technologies.
- Project-team and potential client interviews.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
11 дней назад
Data Engineer (AI)
13 дней назад
Senior / Lead Developer - DataBricks | Data Factory | SQL
9 дней назад
Azure Databricks Technical Lead
Databricks
11 дней назад
Senior Forward Deployed Engineer (Technical Data Architect)
Databricks
9 дней назад
Senior Solutions Architect (Data & AI)
Databricks
9 дней назад