Data Engineer (Azure Databricks)

TL;DR

Data Engineer (Azure Databricks): Building and optimizing scalable, high-performance data pipelines for real-time and batch analytics in the financial capital markets domain with an accent on Databricks administration, pipeline support, and CI/CD. Focus on enhancing existing data infrastructure, ensuring continuity, and collaborating on data requirements in an Agile environment.

Company

hirify.global is an energetic and diverse corporation providing leveraged online trading services to over 2 million customers through global power brands like FXTM and Nemo, with central offices in the UAE, Cyprus, and the UK.

What you will do

• Design, develop, and maintain robust data pipelines using Azure Databricks, Confluent, Spark, and Delta Lake for trading and market data workflows.
• Enhance existing data pipelines, ensuring continuity, scalability, and performance improvements.
• Provide production pipeline support services, including job monitoring, incident resolution, and performance tuning.
• Administer Databricks workspaces and Unity Catalog, covering cluster configuration, job scheduling, and access control.
• Build and maintain CI/CD pipelines using GitLab for automated testing, deployment, and versioning of data engineering code.
• Collaborate with fellow team members, business analysts, and data architects to understand data requirements and deliver high-quality solutions.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in data engineering, with at least 2 years working with Azure Databricks.
• Strong proficiency in PySpark, SQL, and Python.
• Experience supporting production pipelines, including monitoring, alerting, and troubleshooting.
• Experience with GitLab CI/CD, including pipeline configuration, runners, and integration with cloud services.
• Familiarity with financial capital markets domain (market data feeds, order books, trade execution, and risk metrics).
• Proven ability to work effectively in Agile development environments.
• English: B2 required.

Nice to have

• Azure certifications (e.g., Azure Data Engineer Associate).
• Experience with real-time data processing using Kafka or Event Hubs.

Culture & Benefits

• Core belief in "Freedom to Succeed," encouraging learning, exchange, advancement, and prosperity.
• Opportunity to develop a range of skills, take on early responsibility, and enjoy a rewarding career.
• Diverse company with central offices in the UAE, Cyprus, and the UK, plus smaller global hubs.
• Equal opportunities employer, encouraging applications regardless of gender, sexual orientation, race, disability, or age.