Software Architect (AI Infrastructure)

Location: San Jose, California, United States

Salary: $245,000–$325,000 USD base salary per year

Company

hirify.global builds integrated hardware and software platforms for enterprise and government generative AI and high-performance computing.

What you will do

• Own the end-to-end technical architecture of the SambaStack AI inference platform.
• Define architectural strategy and technical direction across multiple engineering teams.
• Lead design reviews and provide guidance for major platform capabilities and cross-cutting system changes.
• Identify and resolve performance bottlenecks, reliability gaps, and scaling constraints.
• Establish architectural standards, patterns, and engineering best practices.
• Partner with ML Engineers, Product Managers, QA, and DevOps to design systems for production-scale AI inference workloads.

Requirements

• 12+ years of software engineering experience, including organization-wide technical influence.
• Experience owning large-scale distributed systems architectures from design through production.
• Expertise building backend systems with Python, Go, or Rust.
• Expert-level Kubernetes knowledge, including Operators, Helm Charts, and cluster-scale resource management.
• Strong understanding of consistency, fault tolerance, observability, and performance at scale.
• Experience setting technical direction, aligning multiple teams, communicating complex decisions, and mentoring engineers.

Nice to have

• Experience with AI inference serving, orchestration, and production-scale LLM infrastructure.
• Experience designing systems for GPUs, TPUs, dataflow architectures, or other hardware accelerators.
• Background in ML application optimization and productionization.
• Experience building cloud-native enterprise platforms with stringent SLA and compliance requirements.
• Experience at a high-growth AI infrastructure company or familiarity with AI coding assistants and developer tooling.

Culture & Benefits

• Work on an integrated AI hardware and software platform addressing complex computational problems.
• US-based full-time employees receive equity and a comprehensive benefits package.
• Medical insurance premiums are covered at 95% for employees and 77% for dependents.
• Benefits include HSA and FSA options, dental and vision insurance, disability coverage, life insurance, and AD&D.
• Well-being benefits include Headspace, Gympass+, One Medical, and counseling services through an Employee Assistance Program.