Назад
Company hidden
5 дней назад

Senior Data Engineer - Databricks

Формат работы
remote (только Brazil)
Тип работы
fulltime
Грейд
senior
Английский
c1
Страна
Brazil
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer - Databricks (Databricks/DataOps): Building and maintaining large-scale data pipelines in Databricks by integrating and transforming APIs, relational databases, files, and other sources with an accent on PySpark, Delta Lake, SQL, and data governance. Focus on designing scalable ETL/ELT workflows, implementing data quality and CI/CD practices, and solving performance, reliability, security, and distributed-processing challenges.

Location: Remote, Brazil

Company

CI&T delivers AI deployment, application modernization, data and AI, martech, and business strategy solutions for large enterprises.

What you will do

  • Develop and maintain large-scale data pipelines in Databricks.
  • Integrate and transform data from APIs, relational databases, files, and other sources.
  • Design robust ETL/ELT workflows using Medallion Architecture and distributed data processing.
  • Collaborate with business, analytics, data science, and platform engineering teams.
  • Ensure the quality, reliability, security, and governance of ingested data.
  • Document data engineering processes and provide technical guidance and mentorship.

Requirements

  • Proven experience building and managing large-scale Databricks data pipelines with PySpark, Delta Lake, and SQL.
  • Strong programming skills in Python and SQL, with deep knowledge of data warehousing and distributed data processing.
  • Hands-on experience with DataOps practices, including Git, CI/CD, automated testing, and infrastructure as code.
  • Familiarity with AWS, Azure, or GCP and related data services.
  • Strong problem-solving skills focused on performance, scalability, and reliability.
  • Advanced English is essential.

Nice to have

  • Experience with data contracts, schema evolution, and cross-service compatibility.
  • Experience with Great Expectations, Soda, dbt tests, or custom data quality solutions.
  • Experience integrating data with Power BI.

Culture & Benefits

  • Work remotely from Brazil.
  • Collaborate across a global organization operating in more than 25 countries.
  • Benefits are provided according to CI&T's local program.

Hiring process

  • Complete an assessment during the selection process.
  • Support is available for candidates who need help obtaining the assessment.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →