Senior Data Platform Engineer (Python)

TL;DR

Senior Data Platform Engineer (Python/Go): Building and scaling the data foundation for a configurable identity platform with an accent on high-throughput ingestion, Iceberg datalake architecture, and distributed systems performance. Focus on designing streaming and batch pipelines, optimizing storage layouts, and ensuring cost-efficient reliability at a scale of hundreds of billions of records per day.

Location: Must be based in or able to work from the San Francisco Bay Area (Hybrid)

Salary: $190,000 – $250,000

Company

hirify.global is a configurable identity platform that helps businesses verify individuals and organizations in a digital-first world.

What you will do

• Build and scale the datalake, including pipelines and storage design.
• Develop high-throughput data-movement and ingestion services.
• Own streaming and batch ingestion, including change-data-capture pipelines.
• Build new query and analytics capabilities directly on the datalake.
• Operate the low-latency serving layer for real-time, high-concurrency access.
• Partner with infrastructure and product teams to provision, secure, and scale the platform.

Requirements

• 5+ years of experience in software engineering with deep expertise in data infrastructure or large-scale distributed systems.
• Proficiency in Python and willingness to work in Go.
• Hands-on experience with big-data or streaming technologies like Spark, Kafka, or Flink.
• Experience building and operating scalable data pipelines across structured and unstructured data.
• Track record of leading complex, multi-quarter infrastructure projects end to end.
• Strong fundamentals in distributed systems, storage, and performance/cost optimization.

Nice to have

• Experience with ClickHouse, DuckDB, GCP, Kubernetes, MySQL, MongoDB, or Snowflake.
• Interest in lakehouse table formats like Iceberg.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance.
• 3% 401(k) contribution for US employees.
• Unlimited PTO and quarterly mental health days.
• Family planning and wellness benefits.
• Professional development stipend.

Hiring process

• Candidates will be asked to verify their identity using the hirify.global platform as part of the interview process.