Data Engineer (Microsoft Fabric)

TL;DR

Data Engineer (Microsoft Fabric/Spark): Designing, building, and maintaining scalable data pipelines and infrastructure to support data-driven initiatives with an accent on data integration, quality, and reliability. Focus on optimizing data processing workflows for performance and scalability using Apache Spark and Microsoft Fabric.

Location: Kuala Lumpur, Malaysia

Company

hirify.global is a leading provider of agentic digital experience software that enables brands to deliver personalized, predictive, and dynamic customer experiences at scale.

What you will do

• Design and develop robust data pipelines using Apache Spark and Microsoft Fabric to process large volumes of data efficiently.
• Integrate data from various sources while ensuring data quality, consistency, and reliability.
• Optimize data processing workflows to improve performance and scalability.
• Collaborate with data scientists, analysts, and other stakeholders to deliver tailored data solutions.
• Implement and maintain data governance practices to ensure security, privacy, and compliance.
• Troubleshoot data-related bottlenecks and maintain comprehensive documentation of workflows.

Requirements

• At least 5 years of experience in data engineering or related fields.
• Proficiency in Databricks, Apache Spark, or Microsoft Fabric.
• Strong programming skills in Python, Scala, or Java.
• Experience with cloud platforms such as Azure, AWS, or GCP.
• Solid knowledge of SQL, NoSQL databases, and ETL processes.
• Bachelor’s degree in computer science, engineering, or a related field.

Nice to have

• Experience with big data technologies and frameworks.
• Knowledge of machine learning and data science concepts.
• Certification in relevant technologies (e.g., Apache Spark, Azure Data Engineer).

Culture & Benefits

• Diverse, passionate, and collaborative global team spanning over 25 countries.
• Active cultivation of AI skills across all teams to drive creativity and efficiency.
• Commitment to equal employment opportunity and a diverse workplace.