pythonsqlterraformdbtsparkdatabrickspysparkdata governancedataopsdelta lake
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
развернуть
По международному рынку данных пока нет
На СНГ рынке: $5.8к/мес ($3.9к - $6.5к)
78
Хорошая вакансия
развернуть
У роли понятный уровень лида и актуальный стек для работы с данными, но в консалтинге проекты и приоритеты могут меняться.
?Консалтинговый формат
Актуальный стек
Понятная роль лида
?Ограничение по странам
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Lead Data Engineer (Databricks): Building and optimizing data pipelines, Lakehouse architectures, and analytics solutions on Databricks with an accent on Apache Spark, Delta Lake, cloud integration, and data governance. Focus on designing scalable batch and streaming systems, automating infrastructure with Terraform, and leading technical reviews and engineering teams.
Location: 100% remote from Brazil, Argentina, Colombia, Peru, Costa Rica, or Mexico
Company
hirify.global is a global digital engineering, product development, and technology consulting company headquartered in New York, with 1,000+ experts across 65+ countries.
What you will do
Lead end-to-end development of data pipelines, ETL/ELT processes, and batch or streaming solutions with Databricks and Apache Spark.
Design Lakehouse architectures and scalable data platform solutions aligned with business and technical requirements.
Collaborate with data scientists, analysts, and engineers to deliver high-performance data products and ML features.
Define coding standards, best practices, performance tuning strategies, and data governance using Delta Lake and Unity Catalog.
Integrate data sources across AWS, Azure, and GCP using native and third-party connectors.
Lead architecture sessions and technical reviews, mentor engineers, and automate infrastructure deployment with Terraform, Databricks CLI, or similar tools.
Requirements
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
5+ years of experience in Data Engineering or Big Data roles, including 2+ years of hands-on experience with Databricks, Spark using PySpark or Scala, and Delta Lake.
Strong knowledge of AWS, Azure, or GCP and modern data architectures such as Lakehouse and Data Mesh.
Proficiency in SQL, Python, and distributed data processing.
Experience with dbt, CI/CD, Git, and DataOps in a data environment.
Deep understanding of data governance, cataloging, and security concepts.
Experience leading a team or project as a team or technical lead.
Excellent written and verbal English communication skills.
Ability to work with many cultures and nationalities, lead conversations with technical and business representatives, and contribute independently or as part of an international project team.
Nice to have
Databricks Pro or Architect certification.
Experience with machine learning pipelines and MLOps in Databricks.
Culture & Benefits
Fully remote work limited to the listed Latin American countries.
Work on global projects with an international community and multicultural teams.
Opportunity to grow skills and shape the way of working.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →