Infrastructure Software Engineer (GenAI)

TL;DR

Infrastructure Software Engineer (GenAI): Building and scaling the core infrastructure for an enterprise-grade AI platform with an accent on multi-cloud architectures and customer data integrations. Focus on designing cloud abstractions across AWS, Azure, and GCP and implementing high-velocity experiments for LLM-powered services.

Location: Must be based in San Francisco, CA; New York, NY, or Seattle, WA

Salary: $179,400 - $224,250 USD

Company

Scale AI provides the high-quality data and full-stack technologies that power the world's leading AI models for enterprises and governments.

What you will do

• Architect multi-cloud systems and abstractions to allow the SGP platform to run on top of existing Cloud providers.
• Implement custom integrations between Scale AI's platform and customer data environments including cloud platforms, data warehouses, and internal APIs.
• Collaborate with platform and product teams to develop and implement scalable infrastructure.
• Deliver high-velocity experiments to engage customers and drive platform evolution.
• Manage the entire product lifecycle from conceptualization through production.
• Rapidly learn and adopt new technologies to solve complex infrastructure challenges.

Requirements

• 4+ years of full-time engineering experience post-graduation.
• Experience scaling products within hyper-growth startups.
• Proficiency in Python or Javascript/Typescript, and SQL.
• Hands-on experience with Kubernetes and major cloud providers (AWS, Azure, GCP).
• Experience productizing LLMs, vector databases, and modern AI technologies.
• Excellent communication skills for explaining technical concepts to both technical and non-technical audiences.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• Equity-based compensation packages.
• Retirement benefits and learning and development stipend.
• Generous PTO and commuter stipend.
• Inclusive and equal opportunity workplace committed to diversity.