Senior Data Engineer (Python/PySpark)

TL;DR

Senior Data Engineer (Python/PySpark): Engineering data pipelines and transformations for domain-specific data products with an accent on scalability, automation, and software engineering best practices. Focus on building robust data contracts, implementing CI/CD deployment practices, and optimizing PySpark transformations.

Location: Hybrid in Reading, United Kingdom

Company

hirify.global is a tech consultancy that helps organisations navigate the future of technology by combining human expertise with AI to deliver better outcomes.

What you will do

• Build and automate data pipelines to ingest, transform, and model data specific to squad use cases.
• Develop structured and scalable code using Python, PySpark, and SQL.
• Apply software engineering best practices, including version control with Git and automated testing with Pytest.
• Collaborate with the Platform Enablement team to productionise sandbox experiments into robust central platform contracts.

Requirements

• Advanced coding skills in Python and PySpark.
• Strong proficiency in SQL.
• Expertise in building declarative pipelines, such as Delta Live Tables.
• Experience with Git and CI/CD deployment practices.
• Proficiency in automated testing using frameworks like Pytest.
• Must be able to work in a hybrid model based in Reading, UK.

Culture & Benefits

• 25 days bookable holiday plus flexible Bank Holidays.
• Pension scheme with 6% employer contribution.
• Aviva healthcare cover, including coverage for pre-existing conditions.
• £1000 Flexibenefit allowance for personalized benefits or cash.
• Life Assurance and Income Protection.
• Generous Enhanced Maternity and Enhanced Partner Leave.