Solution Architect (AI)

Location: Hybrid in San Francisco or New York, United States

Salary: $165K–$330K per year, plus equity.

Company

Baseten provides AI inference infrastructure, applied AI research, and developer tooling for companies deploying machine learning products in production.

What you will do

• Partner with Sales on customer discovery calls and translate business requirements into technical solutions.
• Lead technical demos and scope architectures, deployment approaches, and success criteria.
• Own benchmarking and repeatable deployments for LLMs, embeddings, image and video generation, and Voice AI.
• Advise customers on GPU selection and latency- versus throughput-optimized infrastructure configurations.
• Use inference runtimes such as vLLM, SGLang, and TRT-LLM, evaluating their configurations and tradeoffs.
• Lead POCs as the project coordinator, aligning stakeholders and engaging Forward Deployed Engineering when deeper technical support is required.

Requirements

• Background in AI and machine learning with the ability to discuss technical topics credibly with stakeholders.
• Strong customer-facing communication skills, including structured discovery and requirements clarification.
• Technical depth to scope solutions without writing production code.
• Ability to script and prototype as needed, including comfort with rapid technical experimentation.
• Ability to work in a hybrid role based in San Francisco or New York, United States.

Nice to have

• Experience running or supporting benchmarks for machine learning inference deployments.
• Familiarity with GPU selection and latency-versus-throughput tuning for inference performance and cost.
• Experience leading customer POCs across Sales and Engineering.

Culture & Benefits

• Competitive compensation with meaningful equity.
• U.S. employees and dependents receive full medical, dental, and vision coverage.
• Flexible PTO and a company-wide Winter Break.
• Paid parental leave and a fertility and family-building stipend.
• U.S. employees have access to a company-facilitated 401(k).
• Exposure to a range of machine learning startups and related technical challenges.