Senior Product Engineer (AI)

Location: Hybrid in San Francisco or New York, United States

Salary: $165,000–$330,000 annually, plus equity

Company

Baseten builds AI inference infrastructure and developer tooling that helps leading AI companies bring machine learning models into production.

What you will do

• Own features and products such as multinode training and serverless reinforcement learning from conception through MVP and general availability.
• Design APIs and abstractions for complex training resources and lifecycles.
• Implement features across the API, backend, database, infrastructure, and optionally frontend layers.
• Fine-tune and deploy models to understand training workflows and customer needs.
• Partner with model developers and research engineers to improve post-training workflows.
• Improve system reliability, development velocity, and customer issue resolution.

Requirements

• 5+ years of experience building software applications.
• Deep knowledge of web technologies, databases, and distributed systems.
• Experience developing developer tooling or infrastructure products for internal or external users.
• Strong product judgment for developer-oriented tools.
• Interest in ML/AI infrastructure and willingness to learn.
• High ownership, agency, and communication skills.

Nice to have

• Experience launching products through MVP, beta, and general availability release cycles.
• Experience with supervised fine-tuning, reinforcement learning, synthetic data generation, LoRA, or full fine-tuning.
• Familiarity with NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, Hugging Face Trainer, FSDP, or DeepSpeed.
• Experience building AI products, tooling, or agents.
• Frontend fluency.

Culture & Benefits

• Competitive compensation with meaningful equity.
• Flexible paid time off and a company-wide winter break.
• Paid parental leave and a fertility and family-building stipend.
• For U.S. employees: 100% coverage of medical, dental, and vision insurance and a company-facilitated 401(k).
• Exposure to a variety of ML startups and opportunities for learning and networking.