Назад
Company hidden
3 дня назад

Senior Data Engineer (Azure Databricks/PySpark)

Формат работы
remote (Global)
Тип работы
fulltime
Грейд
senior
Английский
b1
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (Azure Databricks/PySpark): Building and enhancing a cloud-based Lakehouse data platform for logistics, with an accent on data integration, quality management, and analytical solutions powered by Databricks and Power BI. Focus on designing reliable pipelines, optimizing data processing, integrating heterogeneous source systems, and supporting CI/CD and infrastructure automation in Azure.

Location: Fully remote; working remotely or from one of the offices is available.

Company

hirify.global delivers software engineering services through international, long-term client projects.

What you will do

  • Design, develop, maintain, monitor, and optimize data integrations and pipelines with Azure Databricks, PySpark, and Python.
  • Implement integrations according to interface specifications and architectural guidelines, moving data from source systems into data products.
  • Profile data, implement validation and quality rules, and ensure consistency, reliability, and maintainability.
  • Support Power BI semantic models, datasets, reports, and dashboards, including collaboration with analysts and business stakeholders.
  • Contribute to Lakehouse architecture, performance optimization, Agile delivery, testing, and deployment.
  • Support CI/CD and infrastructure automation practices within the Azure ecosystem.

Requirements

  • Proven commercial experience in Data Engineering.
  • Hands-on experience with Azure Databricks and PySpark.
  • Strong programming skills in Python and SQL.
  • Experience designing and implementing ETL/ELT pipelines and data integrations.
  • Good understanding of modern data platform architectures, particularly Lakehouse.
  • Experience with data profiling, data validation, and data quality management.
  • Familiarity with Power BI, including data modeling, semantic models, and/or DAX.
  • Experience with cloud-based data platforms, preferably Microsoft Azure.
  • Understanding of Git-based development workflows and Agile methodologies.
  • Good communication skills and the ability to work in an international team.
  • English and/or German proficiency at B1–B2 or higher, depending on project requirements.

Nice to have

  • Experience with Azure Synapse Analytics.
  • Knowledge of the DQX Framework or a similar data quality framework.
  • Experience with Terraform and Infrastructure as Code.
  • Familiarity with Azure DevOps, GitHub, and CI/CD pipelines.
  • Understanding of Data Mesh principles and API-based integrations.
  • Experience optimizing Power BI data models, reports, and DAX queries.
  • Previous experience in logistics, transportation, or supply chain projects.

Culture & Benefits

  • Long-term international project with expected annual extensions and a flexible start date.
  • Full-time remote engagement with a flexible working schedule.
  • Opportunity to work with modern Azure Data Engineering technologies and an enterprise data platform.
  • Collaboration with an international team and an Austrian client.
  • Twenty business days of covered vacation and five additional days off.
  • Free English classes, legal support, and medical insurance for employees from Ukraine.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →