Назад
Company hidden
48 минут назад

Senior/Lead Data Engineer (Databricks)

Формат работы
remote (только Poland)/onsite
Тип работы
fulltime
Грейд
senior/lead
Английский
c1
Страна
Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior/Lead Data Engineer (Databricks) (Data Platforms): Building scalable data platforms, reusable frameworks, internal tools, and reliable production pipelines on Azure with an accent on Databricks, Spark Lakehouse, data quality, and developer experience. Focus on defining testing and CI/CD standards, evolving schemas and data contracts, improving observability and lineage, and applying AI safely to engineering workflows.

Location: Poland; office, remote, or flexible work

Company

hirify.global is delivering a digital asset operations platform for industrial capital projects and operations, supporting asset search, visualization, navigation, collaboration, and the energy transition.

What you will do

  • Shape the technical direction of the data platform, tooling, engineering standards, and architectural decisions.
  • Design reusable frameworks, internal tools, automation, data models, schemas, data contracts, validation, and schema-evolution approaches.
  • Define testing, CI/CD, quality-gate, observability, reliability, data-quality, and lineage practices.
  • Turn recurring delivery challenges into scalable platform capabilities that simplify customer onboarding and improve developer experience.
  • Lead technical discussions, mentor engineers, document best practices, and guide adoption of standard platform patterns.
  • Apply AI to engineering workflows with safeguards and measure its impact on productivity and quality.

Requirements

  • Extensive experience designing, building, and evolving scalable data platforms and production data pipelines using Databricks, Spark, and Spark Lakehouse on Azure.
  • Experience with Azure SQL Database, Azure Blob Storage, MSSQL databases, and infrastructure provisioning with Terraform.
  • Strong software engineering skills in Python and SQL, including reusable frameworks, tooling, automation, ruff, and pytest.
  • Strong understanding of data modeling, schema evolution, data contracts, and validation across MSSQL and Spark Lakehouse source systems, including monolithic architectures.
  • Practical experience with automated and integration testing, linting, quality gates, infrastructure automation, and deployment pipelines using GitLab Actions.
  • Experience with Grafana-based observability and monitoring, operational troubleshooting, and reliable Azure data services.
  • Experience improving data quality and lineage in Databricks and Spark.
  • Ability to simplify engineering workflows, including project and issue tracking in Linear, and create maintainable tools from repeated manual work.
  • Experience identifying practical AI use cases with GitHub Copilot and ChatGPT, evaluating effectiveness, and defining quality and reliability safeguards.
  • Technical leadership experience, including design leadership, mentoring, engineering standards, collaboration, and architectural trade-offs.
  • English proficiency at C1+ and Polish proficiency at C1+ or native level are required.

Culture & Benefits

  • Flexible remote, office-based, or flexible working format in Poland.
  • Competitive salary and compensation package.
  • Personalized career growth, mentorship, tech talks, trainings, and centers of excellence.
  • Active technology communities, education reimbursement, corporate events, team buildings, and location-specific benefits.
  • Benefits listed are not applicable for freelancers.

Hiring process

  • Applications can be submitted through Easy Apply or by referring a friend.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →