TL;DR
Data Engineer: Improving services by engineering data products with an accent on designing, building, and supporting high quality engineering products from extensive data sources and multi-cloud environment. Focus on exploring new technologies, developing new skills, innovating and growing as an engineer.
Location: Riverside Tower, Belfast (N.I), United Kingdom. Working Style: 3 days a week in office, 2 days from anywhere. All Locations: London, Belfast
Company
hirify.global was the world’s first telco and our heritage in the sector is unrivalled.
What you will do
- Design, develop, and maintain end-to-end data pipelines using Ab Initio (GDE, PDL, Conduct >IT, Express>IT).
- Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).
- Develop and orchestrate data ingestion flows using Apache NiFi for real-time and near-real-time use cases.
- Optimize ETL/ELT jobs for scalability, throughput, and resource efficiency.
- Improve automated testing and deployments using CI/CD pipelines.
- Expectation to line manage small team of junior data engineers.
Requirements
- Proficient in building Big Data solutions using Hadoop or GCP or AWS.
- Skilled in technologies such as Scala, Java, Python, Spark (PySpark/Scala), Kafka, Kinesis, BigQuery, Dataflow, BigTable, Terraform, and SQL.
- Strong expertise in Ab Initio (GDE, PDL, Conduct>IT, Express>IT, EME) with a focus on parallel processing and component optimisation.
- Hands-on experience with Apache Spark, including Spark SQL, Spark Streaming, and performance tuning.
- Practical experience with Apache NiFi for flow design, processor tuning, error handling, and security configurations.
- Experienced in version control using Git or SVN.
Culture & Benefits
- 10% on target bonus.
- BT Pension scheme, minimum 5% Employee contribution, BT contribution 10%.
- Life Assurance Cover.
- Exclusive colleague discounts on our latest and greatest BT broadband packages, BT TV with TNT Sports and NOW Entertainment.
- 25 days annual leave (not including bank holidays), increasing with service.
- World-class training and development opportunities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →