Specialist Data Platform Engineering

TL;DR

Specialist Data Platform Engineering: Designing, building, and maintaining scalable data pipelines and systems including enterprise Data Lake and Databricks environment with an accent on data ingestion, transformation, and real-time streaming. Focus on optimizing distributed data processing, ensuring system reliability, and collaborating cross-functionally for compliance and governance.

Company

hirify.global builds uncomplicated service software delivering exceptional customer and employee experiences with a people-first approach to AI, trusted by over 72,000 companies worldwide.

What you will do

• Own and manage enterprise Data Lake infrastructure on AWS and Databricks ensuring scalability and governance.
• Design and optimize data ingestion and transformation pipelines using MySQL, Kafka, and Spark Structured Streaming.
• Build and maintain batch and real-time data pipelines for high-volume data needs.
• Implement and optimize MapReduce jobs and distributed data processing workflows.
• Develop observability and monitoring systems to ensure system reliability and performance.
• Collaborate cross-functionally to ensure compliance, data privacy, and quality across the data lifecycle.

Requirements

• English: B2 level or higher required
• 4-6 years of experience in data engineering or related domains.
• Strong programming skills in Scala, Spark, Java, or Python.
• Experience with Kafka, Databricks, AWS cloud services, and Kubernetes (EKS preferred).
• Knowledge of data lakehouse architectures and data governance principles.
• Familiarity with CI/CD pipelines and monitoring frameworks like Prometheus and Grafana.

Culture & Benefits

• Inclusive environment welcoming diverse backgrounds and perspectives.
• Commitment to equal opportunity and fostering employee potential and passion.
• Focus on real impact and innovation in software solutions.