Staff Software Engineer (AI)

TL;DR

Staff Software Engineer (AI): Build and deliver an enterprise AI and machine learning platform that accelerates ML/AI from exploration to production and enables Generative AI applications with foundation models using enterprise data at scale. Focus on designing scalable AI inference services, implementing an AI model registry and AI applications, and solving complex distributed-systems challenges with strong collaboration across engineering, data science, UX, and product.

Company

hirify.global develops enterprise data and AI platforms powered by open source innovation.

What you will do

• Build the enterprise platform for AI and machine learning.
• Design, code, and implement scalable, enterprise-quality AI inference services powered by ML models.
• Design and develop an AI model registry and Generative AI applications.
• Improve developer velocity and team agility.
• Collaborate closely with front-end/web UI engineers, data scientists, quality engineers, UX designers, and product management.

Requirements

• 10+ years of experience building scalable microservices or applications using Go, Python, Node.js, C#, or Java.
• Experience building and deploying AI inference and Generative AI applications.
• Experience with foundation models, prompt engineering, fine-tuning, semantic search, and Retrieval-Augmented Generation (RAG) using vector databases (e.g., Pinecone, Milvus).
• Experience with microservices design and development (Go, gRPC, SQL) on Kubernetes.
• Strong ability to work on complex distributed systems with high-level and low-level design skills.
• Location: San Jose, California, United States

Culture & Benefits

• Generous PTO policy and support for work-life balance with Unplugged Days.
• Flexible WFH policy.
• Mental and physical wellness programs, plus phone and internet reimbursement.
• Access to continued career development, comprehensive benefits, and competitive compensation.
• Paid volunteer time and employee resource groups.

Hiring process

• Interviews focused on technical depth, system design, and collaboration across teams.
• Evaluation of experience with AI inference, Generative AI, and scalable distributed systems.