Software Engineer (AI Infrastructure)

Location: San Mateo, United States

Salary: $175K–$220K per year, plus equity

Company

hirify.global provides a platform for building, training, and serving specialized AI models across text, image, embedding, audio, and multimodal workloads.

What you will do

• Design and develop scalable backend infrastructure for distributed training, inference, and data pipelines.
• Build and maintain LLM CI/CD pipelines, control-plane services, and model-serving systems.
• Improve performance, cost efficiency, reliability, and availability across compute, storage, and networking layers.
• Build frameworks and safeguards that support high-quality AI models.
• Collaborate with cloud infrastructure, performance, training, and product teams to translate research and product needs into infrastructure solutions.
• Participate in code reviews, technical discussions, and continuous integration and deployment.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 3+ years of software engineering experience focused on infrastructure or machine learning systems; 5+ years is listed as an additional qualification.
• Strong programming skills in Python, Go, or a similar language.
• Experience with ML infrastructure and tooling such as PyTorch, MLflow, Vertex AI, SageMaker, or Kubernetes.
• Basic understanding of LLM concepts including context length, disaggregated prefill, and KV cache memory estimation.

Nice to have

• Experience with open-source inference engines such as vLLM, Sglang, or TRT-LLM.
• Contributions to open-source infrastructure or machine learning projects.
• Experience building large-scale ML/MLOps infrastructure.

Culture & Benefits

• Opportunity to solve complex AI infrastructure problems, including low-latency inference and scalable model serving.
• Work with bleeding-edge AI technology used by businesses and developers.
• High ownership and direct impact in a fast-growing engineering organization.
• Collaboration with experienced engineers and AI researchers.
• Equity included in the compensation package.