Cloud Data Platform Engineering Lead (GCP)

TL;DR

Cloud Data Platform Engineering Lead (GCP): Architect and drive enterprise-scale data solutions on Google Cloud Platform with an accent on performance, security, AI/ML integration, and data lifecycle management. Focus on designing high-throughput pipelines using Apache Spark, Flink, and Dataflow, optimizing cloud costs, and establishing data governance frameworks.

Location: Hybrid model requiring 2 days per week on-site at 20 S Wacker Dr, Chicago, IL 60606. First preference for local candidates in the Chicago area.

Salary: $138,800-$231,300

Company

World’s leading derivatives marketplace impacting global markets.

What you will do

• Architect enterprise data solutions using GCP services like BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Vertex AI, focusing on performance and security.
• Drive adoption of cloud-native tools including Kubernetes, Terraform, Argo Workflows, and CI/CD frameworks.
• Integrate data workflows with operational and analytical stores for system interoperability.
• Scout and adopt emerging GCP services to future-proof the data platform.
• Define data lifecycle strategies adhering to governance and regulatory standards.
• Optimize cloud costs and establish best practices for data quality, metadata, and lineage.
• Mentor teams on Java and Python development best practices.

Requirements

• Bachelor’s or Master’s in Computer Science or related field.
• 10+ years software/data engineering, including 5+ years hands-on GCP architecture.
• Expert in Java, strong in Python.
• Mastery of Kubernetes, Terraform, KCC, Argo Workflows, CI/CD.
• Advanced GCP knowledge: BigQuery, Cloud SQL, IAM, KMS, GKE, GCS, Pub/Sub, Vertex AI.
• Experience with Apache Spark/Flink in Java ecosystem.
• Understanding of data stores, semantic layers (Looker/Tableau), SDLC, data security.

Nice to have

• Google Cloud Professional Data Engineer or Cloud Architect certification.

Culture & Benefits

• Supportive environment with career progression and continuous learning.
• Comprehensive benefits: health coverage, 401(k), pension, education reimbursement, paid time off, mental health support.
• Annual bonus and equity program.
• Inclusive culture valuing diverse perspectives.