Staff Software Engineer, Data Platform (AI)

TL;DR

Staff Software Engineer, Data Platform (AI): Designing and developing core data storage, streaming, and indexing platforms to power large-scale LLMs with an accent on reliability and scalability. Focus on building high-performance distributed systems and driving technical architecture for AI data engines.

Location: San Francisco, CA or New York, NY

Salary: $252,000 - $315,000 USD

Company

An AI data engine provider that powers the world's leading generative models through RLHF and high-quality human data generation.

What you will do

• Drive the architecture, design, and reliability of foundational data platforms and systems.
• Collaborate with cross-functional teams to define and deliver new platform features.
• Identify and implement improvements to programming practices and tool upgrades.
• Provide technical leadership by upholding engineering standards and mentoring junior engineers.
• Present technical insights and guidance to stakeholders regarding development processes.

Requirements

• 8+ years of engineering experience specializing in back-end and large-scale data systems.
• Expertise in databases (MongoDB, Postgres) and streaming solutions (Kinesis, Flink, Spark).
• Experience with indexing/caching tools (ElasticSearch, Redis) and query engines (Trino, Presto, Snowflake).
• Proficiency with Kubernetes and public cloud offerings.
• Deep understanding of distributed systems and cloud platforms.
• Must be based in San Francisco, CA or New York, NY.

Nice to have

• Knowledge of CI/CD tooling, specifically CircleCI.
• Experience with performance tuning and cost optimization for cloud data platforms.
• Experience with data privacy strategy and GDPR implementation.
• Experience scaling products within hyper-growth startups.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• Equity compensation and retirement benefits.
• Learning and development stipend.
• Generous PTO and commuter stipend.
• Inclusive and equal opportunity workplace.