Software Engineer, Frontier AI Infrastructure (AI)

TL;DR

Software Engineer, Frontier AI Infrastructure (AI): Building and optimizing the model inference layer and secure scalable backend systems for Public Sector customers with an accent on cloud-native AI infrastructure and government compliance. Focus on re-architecting stacks for air-gapped environments, designing swappable components for security mandates, and implementing proactive integration testing.

Location: Hybrid (must work 3-4 days a week from DC, SF, NYC, or STL offices). Must hold an active secret clearance.

Salary: $138,000 - $259,440 USD

Company

Scale AI develops reliable AI systems for the world's most important decisions, providing high-quality data and full-stack technologies for enterprises and governments.

What you will do

• Design and implement secure, scalable backend systems using cloud-native AI infrastructure for Public Sector clients.
• Own the model inference layer, managing networking, latency, and pricing/usage metrics for AI models.
• Re-architect the tech stack for compliant, restrictive, and air-gapped environments by designing swappable components.
• Develop integration tests to prevent failures upstream and transition from reactive debugging to proactive testing.
• Lead technical discussions with cloud vendors and customers to deliver on critical contracts.
• Contribute to the platform roadmap and product strategy for the Public Sector business.

Requirements

• Active secret clearance is mandatory; must be willing to upgrade to TS/SCI with CI Poly.
• Must be able to support work 3-4 days a week from the DC, SF, NYC, or STL office.
• Proficiency in full-stack development, including modern frameworks, languages, and databases.
• Experience with containerization (Docker) and orchestration (Kubernetes).
• Knowledge of cloud platforms (AWS, Azure, GCP) and cloud-native deployment.
• Familiarity with Federal Compliance frameworks such as FedRAMP, Cloud SRG, and STIG Benchmarks.

Nice to have

• Experience delivering software to air-gapped or isolated environments.

Culture & Benefits

• Competitive compensation package including base salary and equity.
• Comprehensive health, dental, and vision coverage.
• Retirement benefits and a learning and development stipend.
• Generous PTO and commuter stipends for eligible roles.
• Inclusive and equal opportunity workplace culture.