Member of Technical Staff (AI)

TL;DR

Member of Technical Staff (Backend/AI Infrastructure): Designing and maintaining large-scale backend and cloud-native infrastructure for a generative AI platform with an accent on distributed machine learning training, inference, and data processing pipelines. Focus on building scalable, resilient systems and optimizing compute cost, storage, and network performance.

Location: Must be based in New York, NY

Salary: $175,000 - $220,000 USD

Company

hirify.global is a Series C generative AI infrastructure company delivering high-performance LLM inference and scalable models.

What you will do

• Architect and build scalable backend infrastructure to support distributed ML training, inference, and data processing pipelines.
• Design and implement core backend services with a focus on efficiency and low latency.
• Drive infrastructure optimization initiatives for compute costs, storage lifecycle management, and network performance.
• Lead technical design discussions, mentor engineers, and establish best practices for large-scale ML systems.
• Integrate cloud-native and open-source technologies such as Kubernetes, Ray, Kubeflow, and MLFlow.
• Own end-to-end systems from design to deployment, emphasizing reliability and operational excellence.

Requirements

• Bachelor's degree in Computer Science or a related field.
• 4+ years of experience designing and optimizing large-scale backend infrastructure and distributed data systems (e.g., PostgreSQL, Kafka, Spark) in cloud environments (AWS, GCP, Azure).
• Proficiency in server-side languages such as Python, C++, Go, or TypeScript.
• Experience developing data processing and API systems using frameworks like gRPC or Thrift.
• 2+ years of experience with cloud-native tools, specifically Docker and Kubernetes.
• Proven ability to write technical design documentation and lead cross-functional projects.

Culture & Benefits

• Opportunity to solve hard problems at the forefront of AI infrastructure and low-latency inference.
• Direct ownership and impact in a fast-growing startup environment with no bureaucracy.
• Collaboration with world-class engineers and AI researchers from Meta PyTorch and Google Vertex AI.
• Comprehensive benefits package and meaningful equity in a high-valuation company.