Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (Python/Spark): Building and optimizing AI-ready data platforms and cloud-native infrastructure with an accent on LLM-ready data pipelines, event-driven systems, and greenfield initiatives. Focus on migrating legacy systems to the cloud, implementing medallion architecture, and designing agentic AI data workflows.

Location: Remote (Europe, Ukraine)

Company

hirify.global is a global IT services and software development provider offering diverse domain experience and a wide variety of technologies.

What you will do

• Design and build scalable, cloud-native data platforms from greenfield to production.
• Implement near-real-time ingestion pipelines using event-driven patterns.
• Define platform standards including Lakehouse principles, medallion architecture, and data contracts.
• Refactor and optimize Spark and PySpark scripts for performance and maintainability.
• Drive adoption of AI tooling and agentic workflows within the data engineering team.
• Ensure data quality, observability, and reliability across all pipelines and platforms.

Requirements

• 5+ years of professional experience in Data Engineering.
• Expert proficiency in Python and SQL for pipeline development and optimization.
• Strong experience with Apache Spark/PySpark, including performance tuning.
• Hands-on experience with at least one major cloud provider: Azure (preferred), AWS, or GCP.
• Experience with Databricks or Snowflake and stream processing (Kafka).
• English: Upper-Intermediate (B2) level required.

Nice to have

• Familiarity with RAG pipeline design and LLM integration patterns.
• Knowledge of data governance frameworks (Unity Catalog, Apache Atlas).
• Experience with dbt for data transformation and modelling.
• Familiarity with MLflow, Feature Stores, or ML platform integration.

Culture & Benefits

• Remote work options and flexible scheduling.
• Comprehensive health and legal support.
• Active professional community and opportunities for continuous education.
• Diverse business domains and exposure to various technology stacks.
• Sports and community activities.