Назад
Company hidden
2 дня назад

Lead Data Engineer (Databricks)

Формат работы
remote (только Brazil/Argentina/Colombia)
Тип работы
fulltime
Грейд
lead
Английский
c1
Страна
Argentina/Mexico/CR +3 еще
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead Data Engineer (Databricks): Building and optimizing data pipelines, Lakehouse architectures, and analytics solutions on Databricks with an accent on Apache Spark, Delta Lake, cloud integration, and data governance. Focus on designing scalable batch and streaming systems, automating infrastructure with Terraform, and leading technical reviews and engineering teams.

Location: 100% remote from Brazil, Argentina, Colombia, Peru, Costa Rica, or Mexico

Company

hirify.global is a global digital engineering, product development, and technology consulting company headquartered in New York, with 1,000+ experts across 65+ countries.

What you will do

  • Lead end-to-end development of data pipelines, ETL/ELT processes, and batch or streaming solutions with Databricks and Apache Spark.
  • Design Lakehouse architectures and scalable data platform solutions aligned with business and technical requirements.
  • Collaborate with data scientists, analysts, and engineers to deliver high-performance data products and ML features.
  • Define coding standards, best practices, performance tuning strategies, and data governance using Delta Lake and Unity Catalog.
  • Integrate data sources across AWS, Azure, and GCP using native and third-party connectors.
  • Lead architecture sessions and technical reviews, mentor engineers, and automate infrastructure deployment with Terraform, Databricks CLI, or similar tools.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
  • 5+ years of experience in Data Engineering or Big Data roles, including 2+ years of hands-on experience with Databricks, Spark using PySpark or Scala, and Delta Lake.
  • Strong knowledge of AWS, Azure, or GCP and modern data architectures such as Lakehouse and Data Mesh.
  • Proficiency in SQL, Python, and distributed data processing.
  • Experience with dbt, CI/CD, Git, and DataOps in a data environment.
  • Deep understanding of data governance, cataloging, and security concepts.
  • Experience leading a team or project as a team or technical lead.
  • Excellent written and verbal English communication skills.
  • Ability to work with many cultures and nationalities, lead conversations with technical and business representatives, and contribute independently or as part of an international project team.

Nice to have

  • Databricks Pro or Architect certification.
  • Experience with machine learning pipelines and MLOps in Databricks.

Culture & Benefits

  • Fully remote work limited to the listed Latin American countries.
  • Work on global projects with an international community and multicultural teams.
  • Opportunity to grow skills and shape the way of working.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →