Senior Machine Learning Engineer (AI)

TL;DR

Senior Machine Learning Engineer (AI): Developing and optimizing machine learning models for a global serverless inference platform with an accent on low-latency production deployment and resource efficiency. Focus on benchmarking model behavior, implementing inference optimizations like quantization and batching, and scaling AI applications across heterogeneous GPU fleets.

Location: Hybrid (Must be based in Austin, TX)

Company

A global network company dedicated to building a better, faster, and more secure Internet through an intelligent global network.

What you will do

• Develop and productionize ML models for a serverless inference platform, ensuring high performance and reliability.
• Build benchmarking and evaluation frameworks to measure latency and throughput for LLMs, speech, and vision models.
• Optimize inference performance via quantization, batching, caching, and accelerator-aware tuning.
• Integrate models into distributed infrastructure across heterogeneous GPU and next-gen accelerator fleets.
• Improve deployment workflows, focusing on rollout safety, observability, and regression testing.
• Mentor engineers and drive technical direction for production ML engineering practices.

Requirements

• Proven experience building and operating ML models in production environments.
• Strong proficiency in Python and frameworks such as PyTorch, TensorFlow, or JAX.
• Hands-on experience with inference runtimes like vLLM, TensorRT-LLM, SGLang, or Triton.
• Knowledge of LLMs, multimodal models, and retrieval-augmented generation (RAG).
• Ability to optimize models specifically for GPUs or specialized hardware accelerators.
• Must be authorized to receive software/technology controlled under U.S. export control laws without sponsorship.

Nice to have

• Contributions to open source ML tooling, serving frameworks, or inference runtimes.

Culture & Benefits

• Culture of iteration and curiosity, leveraging AI to ship faster and solve tough problems.
• Commitment to protecting the free and open Internet via initiatives like Project Galileo.
• Inclusive environment emphasizing diversity and equal opportunity.
• Collaborative, non-bureaucratic atmosphere focused on technical excellence.