Senior Data Engineer (Azure/Databricks/Python APIs)

TL;DR

Senior Data Engineer (Azure/Databricks/Python APIs): Design and implement scalable data pipelines and data platforms on Azure using Databricks and Spark with an accent on data processing, platform engineering, and API development. Focus on building Python-based services and APIs, infrastructure as code for deployments, and handling large-scale datasets for performance and quality.

Location: Remote, Denmark (Service Region: Nordics)

Company

Digital product engineering company scaling globally with 18,000+ experts across 39 countries.

What you will do

• Design and implement scalable data pipelines and platforms on Azure using Databricks and Spark.
• Develop and maintain Python-based services and APIs (FastAPI/Flask) to expose data.
• Build infrastructure using IaC (BICEP/Terraform) for reliable deployments.
• Work with large-scale datasets, ensuring performance, scalability, and data quality.
• Collaborate with data scientists and stakeholders to support data-driven use cases.
• Implement code quality, testing, deployment automation, data governance, security, and cataloging with Unity Catalog.

Requirements

• 5+ years with Azure Databricks: Unity Catalog, Apache Spark/PySpark, Databricks Asset Bundles.
• Advanced Python (OOP) skills.
• Experience building backend APIs using FastAPI and/or Flask.
• Strong IaC experience: BICEP and/or Terraform.
• Solid data processing at scale and strong SQL knowledge.
• Experience with NumPy and Pandas.

Nice to have

• Broader Azure ecosystem (Data Lake, Key Vault).
• CI/CD pipelines (Azure DevOps, GitHub Actions).
• Data governance (Unity Catalog best practices).
• Microservices architecture.
• Monitoring & observability (Azure Monitor).
• Analytics/data science environments.

Culture & Benefits

• Dynamic, non-hierarchical work culture.
• Focus on tackling client challenges and advancing solutions.
• Opportunity to guide teammates and drive higher-level success.