Назад
Company hidden
10 часов назад

Data Engineer (Azure/Databricks)

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Portugal
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Engineer (Azure/Databricks): Building scalable cloud data platforms, ingestion frameworks, and batch and real-time pipelines with an accent on Azure, Databricks, data governance, and AI-ready data foundations. Focus on designing lakehouse and warehouse architectures, enabling ML and Generative AI workloads, and improving platform reliability through DataOps, CI/CD, and infrastructure automation.

Location: Hybrid in Lisbon or Porto, Portugal

Company

hirify.global delivers technology and data solutions with multidisciplinary teams working on international projects, combining data, AI, and human creativity.

What you will do

  • Design, build, and operate scalable, secure, and resilient cloud data platforms.
  • Develop batch and real-time ingestion, ETL/ELT, transformation, orchestration, and data consumption pipelines.
  • Implement data lake, lakehouse, warehouse, and Data Mesh architectures, including analytical, operational, and AI-driven data models.
  • Integrate structured, semi-structured, and unstructured data from databases, APIs, streaming platforms, SaaS applications, and external sources.
  • Ensure data quality, lineage, observability, security, privacy, access management, encryption, and regulatory compliance.
  • Enable ML, predictive analytics, and Generative AI use cases, including feature engineering, vector databases, embeddings, and RAG architectures; improve reliability, cost efficiency, testing, CI/CD, and Infrastructure as Code.

Requirements

  • Strong proficiency in SQL and data modelling techniques, including dimensional, normalized, and Data Vault models.
  • Strong programming skills in Python and/or Scala, with experience designing and building large-scale data pipelines.
  • Experience with batch and streaming data processing architectures.
  • Mandatory: Microsoft Azure experience and Databricks experience. Experience with AWS or Google Cloud Platform is also relevant.
  • Experience with some of Apache Spark, Apache Kafka, Apache Flink, Apache Beam, Airflow, dbt, Delta Lake, Apache Iceberg, or Apache Hudi.
  • Experience with relational and NoSQL databases, data warehouses, lakehouse platforms, and object storage.
  • Knowledge of Git-based workflows, CI/CD, Infrastructure as Code using Terraform, CloudFormation, or Bicep, containerization with Docker, Kubernetes fundamentals, and automated testing for data pipelines.

Nice to have

  • Azure, Databricks, or Snowflake certifications.
  • Experience with data catalogs, metadata management, data lineage, data quality frameworks, observability platforms, and Master Data Management.
  • Experience with Data Mesh environments, AI/ML platforms, Data Governance programs, FinOps, and cloud cost optimization.
  • Experience mentoring junior engineers and contributing to engineering communities of practice.

Culture & Benefits

  • Hybrid work with flexibility and balance.
  • International projects and opportunities to explore different roles and career paths.
  • Continuous learning and development opportunities.
  • AI-driven environment using modern technologies.
  • Benefits and practical perks supporting day-to-day work.
  • Inclusive, equal-opportunity workplace with adjustments available during the selection process.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →