ΠΡΠ° Π²Π°ΠΊΠ°Π½ΡΠΈΡ Π² Π°ΡΡ ΠΈΠ²Π΅
ΠΠΎΡΠΌΠΎΡΡΠ΅ΡΡ ΠΏΠΎΡ ΠΎΠΆΠΈΠ΅ Π²Π°ΠΊΠ°Π½ΡΠΈΠΈ β8 Π΄Π½Π΅ΠΉ Π½Π°Π·Π°Π΄
Senior Software Engineer (AI)
170Β 000 - 205Β 000$
ΠΠΏΠΈΡΠ°Π½ΠΈΠ΅ Π²Π°ΠΊΠ°Π½ΡΠΈΠΈ
Π’Π΅ΠΊΡΡ:
TL;DR
Senior Software Engineer (AI): Building and scaling managed AI services, including fault-tolerant queues, model catalogs, and cost- and performance-optimized scheduling mechanisms, with an accent on distributed systems, Kubernetes, and generative AI infrastructure. Focus on designing systems for millions of API requests per second, implementing 24/7 monitoring and availability, and optimizing GPU inference performance.
Location: On-site in San Francisco, CA, or Sunnyvale, CA, United States
Salary: $170,000β$205,000 annually plus bonus; restricted stock units included.
Company
builds vertically integrated energy and AI infrastructure for demanding AI workloads, spanning energy, manufacturing, data centers, and cloud services.
What you will do
- Lead the architecture and implementation of managed AI services and core platform systems.
- Build resilient, fault-tolerant queues for efficient task distribution.
- Develop model catalogs for managing and versioning AI models.
- Design scheduling mechanisms optimized for cost and performance.
- Scale infrastructure to support millions of API requests per second across thousands of customers.
- Implement monitoring and alerting for system health and 24/7 availability while collaborating on the AI platform roadmap.
Requirements
- 4β5+ years of industry experience leading a varied portfolio of engineering initiatives.
- Experience with distributed systems, cloud services, and delivering early-stage projects quickly.
- Experience with generative AI, including LLMs and multimodal systems, plus AI infrastructure for training, inference, and ETL pipelines.
- Proficiency with Kubernetes or other container and distributed cluster orchestration systems, microservices, REST APIs, gRPC, and CI/CD.
- Advanced degree in computer science or engineering.
- Ability to work on-site in San Francisco or Sunnyvale, California.
Nice to have
- Production experience with Golang, Python, or Rust.
- Contributions to open-source AI projects such as vLLM.
- Experience optimizing GPU systems and inference frameworks.
Culture & Benefits
- Collaborative environment with autonomy and cross-functional work across product management, business strategy, and engineering.
- Opportunities to influence long-term architecture, prototype emerging technologies, and contribute to the AI community.
- Equity and restricted stock units, paid time off, holidays, and leave programs.
- Health, dental, vision, life, disability, parental leave, and mental health benefits.
- Professional development, tuition reimbursement, commuter benefits, daily meals allowance, and a 401(k) plan with company matching up to 4% of salary.