Software Engineer, Infrastructure (AI)

TL;DR

Software Engineer, Infrastructure (AI): Designing, building, and maintaining core systems for an AI platform with an accent on reliability, scalability, and performance of LLM inference serving. Focus on architecting distributed systems, evolving CI/CD pipelines, and creating self-serve infrastructure platforms to enable rapid product delivery.

Location: On-site (San Francisco, Atlanta, New York, London, Paris, Madrid, Munich, Singapore, Japan, or Sydney)

Compensation: $230,000 – $390,000 + Equity

Company

hirify.global is an AI platform company dedicated to helping businesses build human-centric customer experiences, founded by industry veterans from Salesforce and Google.

What you will do

• Ensure the reliability, scalability, and performance of the platform and LLM inference serving.
• Build and maintain cloud infrastructure using Terraform for secure and reproducible environments.
• Create a self-serve infrastructure platform to empower engineering teams.
• Own and evolve CI/CD pipelines and release management processes.
• Architect and operate distributed systems, including databases and ML model serving.
• Enhance observability tooling to provide deep visibility into platform health.

Requirements

• 5–7+ years of hands-on software engineering experience in highly technical products.
• Proven experience with cloud platforms (AWS, GCP, or Azure) and infrastructure as code (Terraform).
• Hands-on expertise in CI/CD systems, release management, and container orchestration (Docker, Kubernetes).
• Experience with observability tools like Prometheus, Grafana, or Datadog.
• Strong background in incident response and operating distributed systems in production.
• Must be able to work on-site at one of our global office locations.

Nice to have

• Production experience working with LLMs and machine learning models.
• Background in agentic architecture and running SaaS services at scale.
• Familiarity with security and authentication protocols (OAuth, SSO, mTLS).
• Previous experience in a fast-paced startup environment.

Culture & Benefits

• Flexible (unlimited) paid time off.
• Comprehensive medical, dental, and vision benefits for employees and families.
• Retirement plan and life insurance.
• Parental leave and fertility/family building benefits through Carrot.
• Daily lunch, snacks, and coffee provided in-office.
• Discretionary benefit stipend and unique perks like free alphorn lessons.