Data Engineer (AWS, Spark) (Contract)

TL;DR

Data Engineer (AWS, Spark) (Contract): Design, build, and evolve scalable data infrastructure, pipelines, and analytics platforms with an accent on AWS-based pipeline engineering, Apache Spark processing, and Redshift/warehouse modeling. Focus on implementing secure, governed ETL/ELT workflows, optimizing performance and data quality, and providing technical leadership across the full data engineering lifecycle.

Location: UK Remote (UK-based)

Salary: day rate (negotiable)

Company

Technology solutions provider specializing in secure, scalable digital services for the public sector.

What you will do

• Design, build, and maintain robust, scalable, and secure data pipelines using AWS services and Apache Spark.
• Develop and optimize data models for reporting and analytics in Redshift and other data warehouse platforms.
• Monitor, troubleshoot, and optimize ETL/ELT workflows to ensure data quality and pipeline efficiency.
• Implement data governance, security, and compliance best practices in cloud environments.
• Provide technical leadership across architecture, pipeline design, implementation, optimization, monitoring, and standards.
• Collaborate with Data Scientists, Analysts, Business Stakeholders, and DevOps/Platform teams; mentor junior data engineers.

Requirements

• Proven senior-level experience as a Data Engineer using cloud technologies, including hands-on AWS experience.
• Strong AWS expertise (including AWS DMS, S3, Lambda, Step Functions, Glue, Athena, Redshift, and IAM).
• Proficiency in Apache Spark (batch and/or streaming) and big data processing.
• Solid SQL experience with performance tuning in data warehouse environments; experience with Amazon Redshift (table design, workload management, Redshift Spectrum).
• Experience building ETL/ELT pipelines (e.g., AWS Glue, EMR, Apache Airflow or custom frameworks) and familiarity with data modeling.
• UK government/public sector experience and ability to qualify for UK Security Clearance (SC).

Culture & Benefits

• Outside IR35 contract.
• Fully remote working for UK-based candidates.
• Work on meaningful public sector digital services.
• Start ASAP (subject to onboarding).