Software Engineer - Hosted Model Infrastructure (AI)

Location: Palo Alto, California, United States; hybrid workplace

Salary: $145,000–$200,000 per year

Company

hirify.global develops software platforms for data-driven decisions and operations used by government and enterprise organizations.

What you will do

• Build high-performance model-serving infrastructure integrating security models, hardware constraints, and multiple inference engines.
• Design authentication, rate limiting, concurrency control, audit logging, and other request-handling capabilities for multi-tenant model access.
• Build packaging and deployment pipelines for secure, reliable model rollouts across on-premises and air-gapped environments.
• Develop observability, testing, and benchmarking infrastructure for production AI systems across different GPU hardware.
• Debug performance and reliability issues across application code, inference engines, container runtimes, Kubernetes, and GPU drivers.
• Work with product teams and customers to understand requirements, resolve production issues, and integrate hosted model infrastructure with deployment, configuration, and identity systems.

Requirements

• 4+ years of professional software engineering experience building and operating production systems.
• Degree or equivalent engineering background in Computer Science, Mathematics, Software Engineering, Physics, or a related field.
• Strong coding skills in languages such as Java, C++, Python, Rust, or similar; familiarity with the Python ML ecosystem is valuable.
• Experience with containers, Kubernetes, and deploying backend services in production.
• Strong written and verbal communication skills, with the ability to iterate quickly and incorporate feedback.
• Hybrid work in Palo Alto, California, United States.

Nice to have

• Active US Security clearance or eligibility and willingness to obtain one.

Culture & Benefits

• Medical, dental, vision, life, AD&D, and disability insurance options.
• Commuter benefits and a 401(k) plan.
• Flexible paid time off, paid holidays, and supportive leave programs.
• Paid parental leave, backup care, and fertility and family-building benefits.
• Relocation assistance and support for employee health and long-term growth.