Software Engineer, Data Infrastructure (AI)

TL;DR

Software Engineer, Data Infrastructure (AI): Designing and implementing a unified data ensemble architecture to aggregate simulation outputs and user inputs for LLM consumption with an accent on high-throughput batch processing and low-latency data retrieval. Focus on building custom relational data models from scratch to represent complex state-based simulation environments.

Location: New York, NY or Washington, DC

Salary: $186,400 - $233,000 USD

Company

Scale AI develops reliable AI systems for critical decision-making, providing high-quality data and full-stack technologies for enterprises and government agencies.

What you will do

• Architect a unified data ensemble to aggregate deeply structural simulation data and user inputs optimized for LLM consumption.
• Build scalable and resilient data architectures from scratch to handle massive batch throughput with minimal latency.
• Design sophisticated relational data models that accurately represent state-based simulation environments.
• Solve ambiguous product requirements by developing custom ground-up systems where off-the-shelf tools are insufficient.
• Set technical standards for the data infrastructure team, driving code quality and architectural clarity.

Requirements

• 5+ years of backend or data infrastructure experience at a Senior, Staff, or Principal level.
• Expert-level proficiency in Rust, Go, C++, or optimized Python/Java, as well as Spark/PySpark.
• Proven track record of processing massive datasets and optimizing parallel processing across distributed nodes.
• Deep expertise in information retrieval, search/recommendation systems, or complex state management (e.g., Gaming or HFT).
• Must be eligible and willing to obtain a US Security Clearance (Secret or TS/SCI).

Nice to have

• Active Secret or TS/SCI security clearance.
• Experience with LLM context optimization, vector embeddings, or advanced RAG architectures.
• Domain experience in wargaming data, complex systems modeling, or distributed simulation protocols.
• Previous experience in a high-growth, 0-to-1 startup environment.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• Equity compensation and retirement benefits.
• Learning and development stipend.
• Generous PTO and commuter stipend.