Company hidden

24 часа назад

Data Engineer (Databricks)

Формат работы

remote (только Europe)

Тип работы

fulltime

Грейд

senior

Английский

Страна

Ukraine/Poland/Mexico +4 еще

Вакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:

TL;DR

Data Engineer (Databricks/Python): Building scalable cloud-based data platforms and low-latency data services with an accent on Medallion Architecture, API integrations, and batch and real-time processing. Focus on optimizing Spark workloads, designing reusable PySpark transformation frameworks, and ensuring data quality, observability, and pipeline reliability.

Location: Bulgaria, Georgia, Lithuania, Mexico, Moldova, Poland, or Ukraine

Company

hirify.global is delivering a cloud-based data platform project for a global provider of access solutions and smart home technologies in the IoT space.

What you will do

Design, build, and maintain scalable Databricks data pipelines using Python and PySpark.
Implement Medallion Architecture pipelines across Bronze, Silver, and Gold layers.
Build API integrations to ingest data from internal and external systems.
Develop and optimize batch, real-time, and near-real-time processing for performance, latency, reliability, and cost efficiency.
Implement reusable transformation frameworks, data validation, monitoring, and automated testing.
Collaborate with architects, product owners, and engineering teams while improving production reliability, observability, and documentation.

Requirements

5+ years of experience in data engineering.
Strong experience with Databricks, Python, PySpark, SQL, and scalable ETL/ELT pipelines.
Experience with Medallion Architecture, REST API integrations, and real-time or near-real-time data processing.
Experience optimizing Spark workloads for performance and scalability.
Knowledge of data quality, governance, monitoring, and automated testing practices.
English proficiency at B2 level or higher and a bachelor's degree in Computer Science or a related field.

Nice to have

Experience with Delta Lake, Delta Live Tables, Databricks Workflows, or Unity Catalog.
Experience with Apache Kafka or other streaming technologies.
Experience with Azure Data Factory, AWS Glue, or similar orchestration tools.
Experience implementing CI/CD for data pipelines and working in Agile teams.

Culture & Benefits

Flexible work options, including remote and hybrid opportunities.
Technical and non-technical training, internal conferences, and meetups.
Mentorship and professional development support.
Health insurance and sports activities.
Referral and work anniversary programs, plus additional vacation days.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →