Engineering Manager (AI)

TL;DR

Engineering Manager (AI): Leading and mentoring a team to develop and optimize ML model inference and performance with an accent on large-scale optimization techniques and production deployment. Focus on driving technical strategy, solving complex performance bottlenecks, and managing full project lifecycles in a fast-paced startup environment.

Location: San Francisco, United States

Salary: $230,000–$300,000

Company

hirify.global powers inference for leading AI companies by uniting applied AI research, flexible infrastructure, and developer tooling, backed by $150M Series D funding.

What you will do

• Lead and mentor engineers focused on ML model inference and performance optimization.
• Oversee technical strategy and architecture decisions across the engineering organization.
• Collaborate with cross-functional teams to ensure scalable ML model integration in production.
• Analyze and solve performance bottlenecks in frameworks like TensorRT, PyTorch, and CUDA.
• Drive development and deployment of large-scale optimization techniques for ML models, especially LLMs.
• Manage full project lifecycles including planning, execution, and resource management.

Requirements

• Bachelor’s, Master’s, or Ph.D. in Computer Science, Engineering, or related field.
• 5+ years software engineering experience with 2+ years in technical leadership.
• Proven team management and mentoring skills.
• Expertise in Python, C++, or Go and ML performance optimization libraries.
• Strong knowledge of Docker and Kubernetes.
• Experience with production-level AI/ML solutions and scaling large models.
• Location: Must be able to work onsite in San Francisco, United States.

Nice to have

• Experience optimizing large language models (LLMs) and related techniques.
• Deep knowledge of GPU architecture and performance tuning.
• Previous experience in a high-growth startup environment.

Culture & Benefits

• Competitive compensation with meaningful equity.
• Full medical, dental, and vision insurance coverage for employee and dependents.
• Generous PTO including company-wide Winter Break.
• Paid parental leave and company-facilitated 401(k).
• Exposure to diverse ML startups and networking opportunities.