Member of Technical Staff (AI Infrastructure)

Location: Hybrid in San Mateo, United States

Salary: $175K–$220K plus equity

Company

Fireworks AI provides a platform for building, training, and serving specialized AI models across text, image, embedding, audio, and multimodal workloads.

What you will do

• Architect and build scalable, fault-tolerant traffic and networking services, including ingress, egress, load balancing, routing, and quality-of-service controls.
• Lead technical design discussions, mentor engineers, establish infrastructure operating practices, and help set the team's technical direction.
• Optimize networks inside and outside data centers by reducing cost, improving performance, and removing scaling bottlenecks.
• Evaluate and integrate cloud-native and open-source technologies such as Kubernetes, Envoy, and Istio.
• Own systems end to end from design through deployment and observability, with emphasis on high availability, disaster recovery, and operational excellence.
• Develop monitoring, alerting, logging, and tracing for detailed insight into system health and performance.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 5+ years of experience building backend or network infrastructure in cloud environments such as AWS, GCP, or Azure.
• Strong software development skills in Go, C++, Rust, Java, or Python.
• Deep understanding of distributed systems and networking fundamentals, including performance optimization.
• Experience owning the full product lifecycle from design through implementation to production.

Nice to have

• Master's or PhD in Computer Science or a related field.
• Hands-on experience with traffic or edge engineering, service mesh, or cloud networking, including Envoy, Istio, or DPDK.
• Deep Kubernetes experience, including ingress, network policy, and custom controllers.
• Track record of improving performance, reliability, and cost-efficiency on high-throughput systems.
• Experience leading cross-team projects and coaching distributed engineers.

Culture & Benefits

• Work on AI infrastructure challenges including low-latency inference and scalable model serving.
• Use emerging technologies that affect how businesses and developers harness AI.
• Work in a fast-growing, collaborative environment with direct ownership and impact.
• Collaborate with engineers and AI researchers focused on curiosity and innovation.
• Equity is offered as part of the compensation package.