Senior Systems Engineer (Workers AI)

Location: Austin, Texas, United States (hybrid/in-office). Applicants progressing to the offer stage may be asked to attend an in-person interview at a company office or hub.

Company

Large-scale Internet infrastructure and security company operating a global network that protects and accelerates websites and Internet applications.

What you will do

• Design, build, and maintain core components of a serverless AI inference platform.
• Optimize model scheduling, accelerator utilization, load balancing, caching, and request routing to reduce latency.
• Improve platform reliability and resilience by identifying and mitigating systemic risks.
• Expand metrics, logging, tracing, and alerting to detect and resolve production issues proactively.
• Lead cross-functional technical projects from architecture and design through deployment and operationalization.
• Mentor junior engineers and contribute to a collaborative engineering culture.

Requirements

• Proven systems engineering experience focused on distributed, high-performance systems.
• Expert proficiency in Rust, particularly in asynchronous environments.
• Hands-on understanding of networking and application protocols, including TCP, HTTP, and WebSocket.
• Experience with scaling and performance optimization in distributed environments, including load balancing and caching.
• Ability to work in the Austin, Texas hybrid/in-office arrangement.

Nice to have

• Experience with Kubernetes and/or Nomad.
• Familiarity with large-scale inference serving for LLMs and diffusion models.

Culture & Benefits

• Work on infrastructure for real-time voice, open LLMs, and customer-deployed models across a global network.
• Collaborate with AI/ML engineers, hardware partners, and product teams.
• Contribute to projects focused on protecting and improving the open Internet.
• Employment may require authorization to receive technology controlled under U.S. export control laws without sponsorship for an export license.

Hiring process

• Applicants who reach the offer stage may be asked to attend an in-person interview at a company office or hub.