Назад
Company hidden
23 часа назад

Senior Data Engineer (Databricks)

Формат работы
remote (только Europe)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Ukraine/Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (Databricks/AI): Building scalable ETL/ELT pipelines and data infrastructure for petabyte-scale alternative-data analytics with an accent on Databricks, AWS, SQL, Python, Airflow, and data governance. Focus on architecting real-time and batch processing, implementing AI-driven data quality and anomaly detection, and mentoring engineers while driving technical design decisions.

Location: Remote from Ukraine or Poland. Working schedule: 12:00–20:00 CET with at least 2 hours of overlap with colleagues on the US East and West Coasts.

Company

M Science is a data-driven research and analytics firm creating actionable insights from alternative data for financial institutions and corporations; hirify.global is listed as the hiring company.

What you will do

  • Design, build, and maintain scalable ETL/ELT pipelines processing petabytes of data.
  • Architect cloud data solutions with AWS, Databricks, and Snowflake, including real-time and batch workflows with Apache Airflow.
  • Optimize analytical data storage and retrieval, and establish data quality, monitoring, governance, lineage, and metadata practices.
  • Build automated testing and validation for data pipelines and drive CI/CD adoption for data engineering.
  • Lead technical design reviews and architecture decisions, translate business requirements into technical solutions, and mentor junior data engineers.
  • Use AI coding assistants and implement AI-driven data quality checks and anomaly detection.

Requirements

  • 3–8 years of data engineering experience.
  • Expert-level SQL, including complex queries, performance optimization, and window functions.
  • Advanced Python, including object-oriented programming, async/await, and data processing libraries.
  • Apache Airflow experience with DAG development, custom operators, and workflow orchestration.
  • Databricks experience with Spark optimization, Delta Lake, and Unity Catalog governance.
  • AWS experience with S3, EMR, Lambda, and Glue, or equivalent cloud platforms.
  • Experience with dimensional modeling, data vault, and modern data stack patterns.
  • Experience mentoring junior engineers, leading technical initiatives, and collaborating cross-functionally; strong communication skills required.
  • Experience with Agile methodologies and project management, plus the ability to translate business requirements into technical solutions.

Nice to have

  • Experience in financial services, fintech, or data intelligence companies.
  • Background in consumer retail, digital media, or technology verticals.
  • Advanced degree in Computer Science, Statistics, Mathematics, or a related field.

Culture & Benefits

  • 20 days of vacation and public holidays.
  • Mobilization reservation available for Ukrainian colleagues after successful completion of the probation period.
  • Opportunities to exchange experience and work with talented colleagues.
  • Compensation is provided for the work performed.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →