GCP Data Engineer (Google Cloud Platform)

TL;DR

GCP Data Engineer (Google Cloud Platform): Building and optimizing an IAM Data Lake in Google Cloud Platform with an accent on batch and streaming ingestion pipelines. Focus on designing event schemas, implementing Change Data Capture (CDC) patterns, and managing columnar data formats like Parquet and Avro.

Location: Hybrid in Irving, TX (Dallas, TX or Ohio also acceptable)

Company

A professional staffing and recruiting firm providing specialized workforce solutions and technical talent acquisition.

What you will do

• Build and manage a Data Lake within the Google Cloud Platform using big data tools.
• Develop both batch and streaming ingestion pipelines using GCP-native services.
• Design Pub/Sub-based streaming architectures, including event schemas and versioning best practices.
• Implement incremental ingestion techniques and Change Data Capture (CDC) patterns.
• Establish data consumption patterns using views, APIs, and curated analytical datasets.

Requirements

• 4-6 years of hands-on experience with Google Cloud Platform and PySpark.
• 2-4 years of experience with Airflow, CI/CD, and Data Modeling.
• Deep understanding of Google Cloud architecture, including bucket structuring and access control.
• Proficiency with columnar data formats such as Parquet, Avro, and ORC.
• Experience working with the Hadoop/HDFS ecosystem.
• Must be based in or able to work hybrid in Irving, TX, Dallas, TX, or Ohio.