Software Engineer (Infrastructure)

Location: Hybrid or remote across San Francisco, Montreal, New York, Seattle, and Toronto

Salary: $165,000–$330,000 per year, plus equity

Company

Baseten provides an ML inference platform and developer tooling for deploying production AI applications.

What you will do

• Develop infrastructure components for the ML inference platform using Python and Go.
• Implement and maintain Kubernetes deployments for model serving.
• Contribute to the inference orchestration layer for model deployments.
• Build monitoring systems for model performance metrics.
• Develop resource management and infrastructure automation for ML workloads.
• Collaborate on technical solutions while improving performance and system reliability.

Requirements

• Bachelor’s degree or higher in Computer Science or a related field.
• Strong coding ability in one or more popular programming or scripting languages; Go proficiency is beneficial.
• Working knowledge of Kubernetes and containerization.
• Basic understanding of machine learning concepts and model serving.
• Familiarity with distributed systems, monitoring, and logging tools.
• Strong collaboration and communication skills, with an interest in ML/AI infrastructure.

Culture & Benefits

• Competitive compensation with meaningful equity.
• U.S. employees and dependents receive full medical, dental, and vision insurance coverage.
• Flexible PTO and a company-wide Winter Break from Christmas Eve through New Year’s Day.
• Paid parental leave and a fertility and family-building stipend.
• U.S. employees receive access to a company-facilitated 401(k).
• Exposure to a range of ML startups and opportunities for learning and networking.