5 дней назад
Senior Data Quality Engineer, SDET (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Quality Engineer, SDET (Databricks): Building automated validation and reconciliation for data pipelines, data products, reports, and semantic models during a migration to Databricks and Microsoft Fabric with an accent on Python, SQL, CI/CD quality gates, and schema drift detection. Focus on designing unattended regression packs, validating source-to-target consistency, and applying AI-assisted test generation with human review.
Location: Bulgaria, Cyprus, Latvia, Poland, Romania, or Serbia
Company
is a global software engineering company delivering data, analytics, and AI solutions for clients across multiple industries.
What you will do
- Design and implement data testing and quality assurance frameworks.
- Build automated validation for data pipelines and data products.
- Own source-to-target reconciliation between legacy systems and the modern Databricks and Microsoft Fabric platform.
- Create unattended regression packs and automated unit tests within CI/CD pipelines.
- Implement quality gates that can block releases and detect schema drift or unexpected structural changes.
- Validate reports, dashboards, semantic models, measures, filter behavior, and totals, using AI-assisted test generation with human review.
Requirements
- 5+ years of experience in quality engineering, including recent work testing data or ETL processes.
- Strong Python and SQL skills for building test automation.
- Experience validating pipelines through row counts, control totals, referential integrity, and business-rule assertions.
- Experience with source-to-target reconciliation using defined tolerances.
- Experience with CI/CD test automation, release-blocking quality gates, Azure DevOps, and SQL Server.
- English proficiency suitable for direct client conversations is required.
Nice to have
- Experience with Azure Databricks, Microsoft Fabric, or data quality frameworks such as Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, or Deequ.
- Experience designing a test framework from scratch.
- Experience testing semantic models and BI layers.
- Experience in a regulated financial services environment.
- Application test automation experience with Selenium, C#, SpecFlow, or Playwright.
Culture & Benefits
- Flexible work formats, including office, hybrid, and fully remote options, are supported by the company.
- Vacation, sick pay, and state-holiday time off follow the laws of the employment country.
- Health insurance support is available for employees and their loved ones.
- IT certification costs, professional courses, mentoring, and learning platforms are supported.
- Corporate events, technical support, mental health programs, and flexible career development opportunities are available.
Hiring process
- CV review followed by an HR interview.
- Communication and technical assessments covering English and relevant technologies.
- Project-team and, where applicable, client interviews.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →