Senior Data Engineer (GCP)

TL;DR

Senior Data Engineer (GCP/PySpark): Modernizing a large-scale data platform by migrating data assets from Teradata to Google Cloud Platform with an accent on scalable ETL pipelines and big data processing. Focus on migrating nearly 1 petabyte of enterprise data, optimizing high-volume workflows, and ensuring data quality for Fraud and Claims Analytics.

Company

hirify.global is a professional staffing firm providing high-performing engineering talent for enterprise-level initiatives.

What you will do

• Design, develop, and maintain scalable ETL pipelines supporting Fraud and Claims Analytics.
• Build and optimize high-volume data processing solutions using PySpark, Python, and SQL.
• Execute the migration of enterprise data assets from Teradata to Google Cloud Platform (GCP).
• Develop cloud-native data solutions leveraging BigQuery, PySpark, and Hadoop.
• Collaborate with business stakeholders and data architects to deliver reliable, cost-efficient solutions.
• Manage and monitor production workloads using AutoSys and maintain integration workflows using Ab Initio.

Requirements

• Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent experience.
• 5+ years of professional experience in Data Engineering or Software Engineering.
• 4–6 years of hands-on experience with SQL, Python, PySpark, and ETL development.
• Proven experience with AutoSys and Ab Initio.
• Experience with cloud technologies, with a strong preference for Google Cloud Platform.
• Deep understanding of data warehousing concepts and large-scale data processing.