Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks): Building and operating a clinical data platform on Databricks with an accent on robust data pipelines, data models, and data quality. Focus on designing and maintaining end-to-end data pipelines for production use, optimizing Databricks jobs, and embedding data quality and governance rules.

Location: Remote from Bulgaria, Georgia, Kazakhstan, Poland, Latvia, Romania, Serbia, Cyprus, or Armenia

Company

hirify.global is a global technology consultancy working on a platform that processes clinical and real-world data for a healthcare/clinical research client.

What you will do

• Design, build, and maintain end-to-end Databricks data pipelines (ingestion, transformation, publishing) for production use.
• Work with and evolve data models (staging, curated, canonical, or dimensional) alongside architects and analysts.
• Embed data quality and data governance rules into all pipelines (checks, validation, monitoring, alerting).
• Optimize Databricks jobs for performance and cost (cluster configuration, partitioning, caching, file layout).
• Collaborate with data architects, analysts, and domain experts to clarify requirements and refine technical solutions.

Requirements

• 5+ years of experience in data engineering, DWH, or big data, including production data pipelines.
• Strong hands-on experience with Databricks: Spark (PySpark/Scala), Delta Lake, Databricks Jobs / Workflows.
• Proven experience designing and operating end-to-end pipelines on Databricks for batch or near-real-time data.
• Experience with data pipelines and CI/CD for data.
• Practical experience with data modeling (layered models, canonical or dimensional models) for analytics and reporting.
• Experience embedding data quality and data governance rules into pipelines (schema checks, business rules, SLOs, monitoring).
• English: Upper-intermediate or higher proficiency required.
• Must be able to work closely with stakeholders in distributed teams and communicate directly with clients.

Nice to have

• Experience designing and delivering PoC solutions on Databricks to quickly validate ideas using real data.
• Experience with ontologies or a semantic layer (business concepts, metrics, mappings) on top of analytical data.

Culture & Benefits

• Vacation as per the laws of your country.
• Assistance with health insurance for you and your loved ones.
• Sick pay: 10 days without a doctor's note, afterwards as per local laws.
• Time off for state holidays, regardless of the client’s schedule.
• Pleasant environment with corporate parties and small get-togethers.
• Comfort service for technical and everyday work problems.
• Opportunity for career growth, IT certifications, and access to top-tier courses and learning platforms.