SDE III - Data Engineering (AI)

TL;DR

SDE III - Data Engineering (AI): Building and scaling the intelligence backbone for an AI-powered commerce platform with an accent on large-scale data pipelines, feature stores, and identity resolution. Focus on designing distributed systems using Spark, Flink, and Kafka to enable hyper-personalized shopping experiences.

Company

hirify.global AI is an AI commerce platform shaping the next wave of e-commerce with inspiration-led shopping.

What you will do

• Design and build scalable batch and real-time data pipelines using Spark, Flink, Kafka, and Airflow.
• Develop systems for user identity resolution and cross-surface signal aggregation across Mobile, TV, and OEM ecosystems.
• Build ingestion and enrichment pipelines for affiliate feeds, merchant catalogs, and product metadata.
• Create reusable feature generation frameworks and low-latency pipelines for ML training and online inference.
• Develop internal AI-powered tools and self-service platforms for pipeline debugging and SQL optimization.
• Ensure production reliability through monitoring, lineage, alerting, and reconciliation frameworks.

Requirements

• 6–10 years of experience in Data Engineering, Distributed Systems, or Data Platform development.
• Strong hands-on expertise with Apache Spark, Kafka, Flink, and Airflow.
• Proficiency in Python, Scala or Java, and SQL.
• Experience with GCP, Databricks, and BigQuery.
• Solid understanding of dimensional modeling, data warehousing, and large-scale schema design.
• Proven track record of owning large-scale production systems end-to-end.

Nice to have

• Experience with product catalogs, affiliate commerce platforms, and recommendation systems.
• Knowledge of identity resolution and Customer 360 systems.
• Experience building MLOps infrastructure and feature stores.
• Exposure to LLM-powered developer tools and agents.