Dedicated Inference Engineer (AI)

Location: Hybrid in San Francisco, Montreal, New York, Seattle, or Toronto

Salary: $165K–$330K annually, plus equity

Company

Baseten provides AI inference infrastructure and developer tooling that helps AI companies deploy cutting-edge models into production.

What you will do

• Build features and products for the Dedicated Inference team.
• Design ergonomic APIs and abstractions for customer workflows.
• Develop CLI, SDK, API, observability, and debugging capabilities for production inference deployments.
• Fix bugs and resolve customer issues with urgency.
• Work across the stack, including React components and Kubernetes pods.
• Collaborate with product and forward deployed engineering teams on new product ideas.

Requirements

• Bachelor's degree or higher in Computer Science or a related field.
• Proficient coding abilities in one or more popular programming or scripting languages.
• Familiarity with web applications and databases.
• Good product judgment, particularly for developer-oriented tools.
• Interest in ML/AI infrastructure and willingness to learn.
• Strong collaboration and communication skills.

Nice to have

• Proficiency in Python, Go, or JavaScript.

Culture & Benefits

• Competitive compensation with meaningful equity.
• U.S. employees and dependents receive full medical, dental, and vision insurance coverage.
• Flexible PTO and a company-wide Winter Break.
• Paid parental leave and a fertility and family-building stipend.
• U.S. employees have access to a company-facilitated 401(k).
• Exposure to a variety of ML startups and related learning and networking opportunities.