Назад
Company hidden
6 дней назад

Software Engineer (Lakehouse and AI Data Platform)

Формат работы
onsite
Тип работы
fulltime
Грейд
middle
Английский
b2
Страна
Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Software Engineer (Lakehouse and AI Data Platform) (Python/Java, Spark, SQL): Building production data pipelines and curated datasets for a modern Lakehouse and AI data platform with an accent on data modelling, quality, reconciliation, and scalable distributed processing. Focus on designing reliable batch and streaming pipelines, optimizing data performance, and supporting analytics and AI use cases.

Location: Warsaw, Mazowieckie, Poland; office-based

Company

hirify.global is a global investment banking, securities and investment management firm with offices around the world.

What you will do

  • Build, enhance, and support batch and streaming data pipelines on the Lakehouse and AI data platform.
  • Develop raw, refined, and curated datasets for analytics, reporting, operational decision-making, and AI use cases.
  • Apply data modelling principles for business entities, relationships, historical changes, schema evolution, and compatibility.
  • Implement data quality controls, reconciliation processes, testing, monitoring, and root-cause analysis.
  • Optimize data processing and storage through partitioning, clustering, and appropriate normalized or denormalized models.
  • Collaborate with engineers, platform teams, and data consumers to deliver reliable production data products.

Requirements

  • Bachelor’s or master’s degree in a relevant discipline, or equivalent practical experience, with strong quantitative or data engineering skills.
  • Strong hands-on programming experience in Python or Java and good working knowledge of SQL.
  • Experience building or supporting production data pipelines in a collaborative engineering environment.
  • Experience with distributed data processing frameworks such as Apache Spark.
  • Knowledge of temporal data modelling, schema design, schema evolution, partitioning, clustering, and data compatibility.
  • Familiarity with version control, testing, release discipline, CI/CD, and data formats including JSON, Avro, and Parquet.

Nice to have

  • Experience with Kafka, Snowflake, Apache Iceberg, Databricks, Hadoop ecosystem technologies, or Sybase IQ.
  • Exposure to containerized or Kubernetes-based deployment approaches.
  • Ability to contribute to technical design, platform standards, and delivery approaches across multiple use cases.

Culture & Benefits

  • Engineering teams build scalable systems and work closely with business and platform users.
  • Training and development opportunities support long-term professional growth.
  • Firmwide networks, wellness programs, and personal finance offerings are available.
  • Reasonable accommodations are available during the recruiting process for candidates with special needs or disabilities.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →