Назад
Company hidden
1 день назад

Senior Databricks Data Engineer

35 000 - 45 000€
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Portugal
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Databricks Data Engineer (Databricks/Python/PySpark): Building and optimizing scalable enterprise data pipelines and data products with an accent on Medallion Architecture, Delta Lake, Unity Catalog, and data governance. Focus on designing large-scale ETL/ELT solutions, optimizing performance and cost, and implementing reliable CI/CD and data quality practices.

Location: Lisbon, Portugal — hybrid

Salary: €35,000–€45,000 gross/year plus other components and benefits.

Company

hirify.global is an IT consultancy and outsourcing company providing scalable technology solutions through the expertise of its consultants.

What you will do

  • Design, build, and maintain scalable data pipelines and enterprise data products using Databricks.
  • Develop and optimize ETL/ELT processes for structured, semi-structured, and streaming data.
  • Implement data models and solutions based on Medallion Architecture, Delta Lake, and modern data architecture principles.
  • Implement governance, access management, metadata, lineage, and data quality initiatives using Databricks Unity Catalog and related solutions.
  • Optimize data processing for performance, scalability, reliability, and cost efficiency.
  • Collaborate with Data Architects, Product Owners, Data Governance teams, and business stakeholders while contributing to automated testing, CI/CD, and deployment.

Requirements

  • 5+ years of professional Data Engineering experience, including 3+ years of hands-on Databricks experience.
  • Strong Python and PySpark development skills and advanced SQL skills, including query and performance optimization.
  • Strong hands-on experience with Delta Lake, Medallion Architecture, Databricks Unity Catalog, and scalable ETL/ELT pipelines.
  • Solid understanding of data modelling and data warehousing concepts, with experience working with large-scale enterprise datasets.
  • Experience with Git, CI/CD and DevOps practices, preferably on cloud-based data platforms such as AWS.
  • Experience working in Agile delivery teams and the ability to independently design and implement Data Engineering solutions.

Nice to have

  • Experience with Databricks Workflows, Databricks Asset Bundles, Data Products, Data Mesh, and enterprise Data Governance solutions.
  • Experience with data quality and observability, governance platforms, metadata management, and data lineage solutions.
  • Exposure to AI, Machine Learning, or Generative AI; REST API integration; or regulated and complex enterprise environments.

Culture & Benefits

  • Hybrid work arrangement in Lisbon.
  • Other components and benefits are included with the gross annual salary.
  • Support is provided during onboarding and integration into the company.

Hiring process

  • Initial contact takes place by phone or video call.
  • To apply, send a CV and include reference RS/SDE/C in the application email.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →