Data Engineer (AI)

Location: San Francisco; New York

Salary: $180K – $250K

Company

Baseten powers mission-critical inference for the world's most dynamic AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling.

What you will do

• Design and maintain core data models and semantic layers.
• Develop and orchestrate batch and streaming data pipelines using technologies such as Apache Beam, Kafka, Airflow, or similar frameworks.
• Analyze inference and infrastructure telemetry, including data from OpenTelemetry, Grafana, and other observability tools.
• Define and maintain company-wide metrics across product usage, performance, and customer lifecycle.
• Enable self-service analytics through agents and tools, with well-structured semantic layers and context.
• Ensure data reliability and quality through testing, documentation, and governance.

Requirements

• Understanding of inference metrics such as latency, throughput, token usage, and model performance.
• Experience supporting B2B SaaS and/or consumption-based platforms.
• Application of forecasting and predictive modeling (e.g., ARIMA, Prophet) to business processes.

Culture & Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Generous PTO policy including company-wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
• Paid parental leave.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.