Data Engineering Specialist (AWS/GCP)

Location: Belfast or London, United Kingdom; hybrid working with 3 days per week in the office and 2 days from anywhere

Salary: Competitive plus benefits

Company

hirify.global is a UK communications group operating brands including BT, EE, Openreach, and Plusnet, serving consumers, businesses, public-sector organizations, and communications providers.

What you will do

• Design, develop, and maintain end-to-end data pipelines using Ab Initio.
• Build scalable batch and streaming workloads with Apache Spark, PySpark, and Scala.
• Develop and orchestrate real-time and near-real-time data ingestion flows with Apache NiFi.
• Optimize ETL/ELT jobs and analyze bottlenecks across Spark jobs, NiFi processors, and Ab Initio graphs.
• Improve automated testing and deployments through CI/CD pipelines.
• Present product developments, share knowledge with stakeholders, and line-manage a small team of junior data engineers.

Requirements

• Experience building Big Data solutions with Hadoop, AWS, or GCP.
• Strong expertise in Ab Initio, including GDE, PDL, Conduct>IT, Express>IT, and EME, with parallel processing and component optimization.
• Hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and performance tuning.
• Practical experience designing and securing Apache NiFi flows, tuning processors, and handling errors.
• Working knowledge of Scala, Java, Python, Kafka, Kinesis, BigQuery, Dataflow, BigTable, Terraform, and SQL.

Nice to have

• Knowledge of Infrastructure as Code and Continuous Integration and Deployment practices.
• Experience with Atlassian tools, Git, or SVN.
• Experience presenting technical issues and outcomes to team members and Product Owners.
• Experience or interest in managing and developing team members.
• Experience building new solutions and supporting existing data products and platforms.

Culture & Benefits

• Agile principles centered on openness, transparency, and continuous improvement.
• Opportunities for internal and external training, learning, and applying new technologies.
• 10% on-target annual bonus.
• Private GP access, paid carers leave, and equalized maternity, paternity, and adoption leave.
• Pension scheme with 5% employee and 10% employer contributions, holiday purchase, and optional healthcare, dental, and gym benefits.