Staff Data Engineer (GCP)

TL;DR

Staff Data Engineer (GCP/Scala): Building the Consumer Data Plane to enable AI-Native experiences, growth marketing, and personalization with an accent on high-throughput streaming pipelines and distributed persistence layers. Focus on designing reusable frameworks, optimizing petabyte-scale data processing, and implementing semantic search and knowledge graphs.

Location: Oakland, California; Mountain View, California

Salary: $202,500 - $274,000

Company

Global financial technology platform powering prosperity for 100 million customers through products like TurboTax, Credit Karma, QuickBooks, and Mailchimp.

What you will do

• Design and maintain high-throughput data frameworks, ETL templates, and streaming pipelines across Credit Karma's engineering organization.
• Develop Scala-based microservices and frameworks utilizing Finagle, Akka Streams, and gRPC to process petabytes of data daily.
• Optimize cloud-native data pipelines on GCP using Dataflow (Apache Beam), Flink, Spark, Pub/Sub, BigQuery, and Spanner.
• Own and evolve Kafka-based streaming infrastructure for hundreds of terabytes of daily events with strict durability and latency guarantees.
• Implement agentic systems, semantic search, and knowledge graphs to power generative AI experiences.
• Create self-service developer tooling, CLI tools, and onboarding automation to reduce platform adoption time.

Requirements

• 7+ years of professional software engineering experience in backend services and data infrastructure using Scala, Java, or other JVM languages.
• 7+ years of experience designing and operating high-throughput, low-latency distributed systems at petabyte scale.
• 3+ years of experience with streaming platforms like Apache Kafka or Google Pub/Sub.
• 3+ years of experience building data pipelines on GCP, AWS, or Azure (e.g., Dataflow, BigQuery, Spanner).
• Professional experience with RPC frameworks (Finagle, gRPC, Akka) and Apache Beam (custom transforms, windowing).
• Knowledge of AI/ML and GenAI technologies, including LLMs, RAG, Semantic Search, and Knowledge Graphs.

Culture & Benefits

• Competitive compensation package with a strong pay-for-performance approach.
• Eligibility for cash bonuses and equity rewards.
• Comprehensive corporate benefits package.
• High-impact, collaborative environment with a culture of technical ownership and continuous learning.