Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (Databricks): Building and optimizing scalable, governed data platforms using Databricks with an accent on medallion architecture, data quality, and incremental processing. Focus on developing production-grade pipelines, implementing Unity Catalog governance, and ensuring system performance and data integrity.
Location: Multiple locations in Europe, CIS, and LATAM (Serbia, Romania, Ukraine, Poland, Cyprus, Mexico, Uruguay, Brazil, Colombia, Bulgaria, Latvia, Argentina); flexible work options available.
Company
is a global software engineering firm that builds bespoke solutions and develops long-term partnerships with clients.
What you will do
- Design, build, and optimize data ingestion pipelines using Databricks.
- Implement and maintain Bronze, Silver, and Gold layers in a medallion architecture.
- Develop and enforce data quality checks at each stage of data processing.
- Configure and manage Unity Catalog for governance, RBAC, and row-level security.
- Collaborate with SMEs and QA teams to align semantic data models.
- Implement monitoring and auditing for ingestion and transformation processes.
Requirements
- Strong experience with Databricks and modern data platform development.
- Hands-on experience with Delta Lake, Lakeflow, and Unity Catalog.
- Proficiency in SQL, PySpark, and Python.
- Solid understanding of medallion architecture and incremental data processing (CDC).
- Experience with CI/CD tools and Git-based workflows.
- Strong problem-solving skills and attention to detail.
Nice to have
- Experience designing enterprise data governance frameworks.
- Background in building semantic layers for BI and reporting.
- Familiarity with data observability and monitoring tools.
Culture & Benefits
- Health insurance for employees and family members.
- Vacation and sick pay in accordance with local legislation.
- Access to professional IT certifications, top-tier courses, and learning platforms.
- Flexible work environment with a focus on work-life balance.
- Corporate events and internal community gatherings.
- Technical and administrative support for everyday work problems.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →