Software Engineer (AI Infrastructure)

Company

Build and operate next-generation AI infrastructure that supports customer AI capabilities and AI-enabled applications.

What you will do

• Procure, configure, test, and prepare new inference models for user access.
• Develop services and techniques that maintain consistently high-quality inference.
• Create reliable pipelines for using closed-source models in collaboration with model vendors.
• Support short-term, high-priority inference needs and surge efforts.
• Establish infrastructure for AI services and integrate LLM-powered tools for user needs.

Requirements

• Top Secret/SCI clearance with Full Scope Poly is required.
• Three years of professional experience, plus a bachelor's degree in a technical discipline or four additional years of experience in place of the degree.
• Experience with Python or other modern programming languages.
• Familiarity with Argo CD or other CI/CD frameworks, Kubernetes, Helm, and AWS or other cloud providers.
• Ability to learn new technologies quickly, communicate clearly, and ask questions.

Nice to have

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
• Experience hosting LLMs and supporting production software with SRE practices.
• Experience with Elastic, Grafana, Prometheus, Docker, and containerization.
• Experience in traffic shaping and quality-of-service engineering.
• Knowledge of and interest in hosting AI capabilities.

Culture & Benefits

• Annual salary of $163,000–$178,000.
• Additional $41,000–$44,000 in immediately vested company 401(k) contributions.
• Work on evolving AI infrastructure requirements and emerging technologies.