Software Engineer (AI)

TL;DR

Software Engineer (AI): Building core backend infrastructure for high-performance generative AI model serving with an accent on distributed systems and cloud scalability. Focus on designing job schedulers, autoscalers, and resource management tools to support low-latency inference workloads.

Location: Must be based in New York, NY or San Mateo, CA

Salary: $140,000 - $150,000 USD

Company

hirify.global is a Series C generative AI infrastructure startup, valued at $4 billion, delivering industry-leading speeds for LLM inference.

What you will do

• Contribute to the design and development of scalable backend infrastructure for distributed AI workloads.
• Build and maintain core services including job schedulers, autoscalers, and model serving systems.
• Optimize performance, cost efficiency, and reliability across compute and storage layers.
• Collaborate with ML and DevOps teams to translate research needs into production infrastructure.
• Participate in code reviews and support CI/CD pipeline improvements.

Requirements

• Bachelor’s degree in Computer Science or a related technical field
• Strong programming skills in Python, C++, or similar languages
• Solid understanding of networking, storage, and distributed computing concepts
• Familiarity with cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes)
• Interest and curiosity in large-scale machine learning platforms

Nice to have

• Industry experience through internships, co-ops, or early-career roles
• Experience with ML frameworks such as PyTorch, TensorFlow, or SageMaker
• Familiarity with infrastructure-as-code tools like Terraform or ArgoCD
• Contributions to open-source AI or infrastructure projects

Culture & Benefits

• Meaningful equity package in a fast-growing, well-funded startup
• Opportunity to work on bleeding-edge AI infrastructure
• Direct impact and ownership over core product systems
• Collaboration with experienced engineers and researchers from top AI labs
• Inclusive and collaborative team environment