Senior Engineering Manager (AI Gateway)

TL;DR

Senior Engineering Manager (AI Gateway): Leading teams to build and scale the AI Gateway, an enterprise control plane for governing and monitoring LLM inference traffic, with an accent on product strategy and technical leadership. Focus on building and growing early-stage AI products, defining architecture for LLM governance, and driving impact across the company's data intelligence platform.

Location: Must be based in New York

Salary: $228,600 – $314,250 USD

Company

hirify.global is the data and AI company that provides a unified platform for data, analytics, and AI, used by over 10,000 organizations worldwide.

What you will do

• Lead engineering teams in building innovative AI/ML products within the NYC hub.
• Drive the development and growth of the hirify.global AI Gateway for LLM inference governance.
• Collaborate with product and research teams to define the roadmap for AI application development.
• Standardize and secure LLM endpoint routing, monitoring, and production data capture.
• Mentor engineering talent and scale team processes in a fast-paced environment.
• Ensure high performance, scalability, and quality of AI infrastructure services.

Requirements

• 8+ years of industry experience in large-scale data or production applications.
• Experience building classic ML or GenAI systems.
• Proven ability to build and scale early-stage products.
• Strong motivation for delivering customer value and impact.
• BS/MS/PhD in Computer Science or related field, or equivalent experience.
• Eligibility to work with export-controlled technology (US government license discretion).

Culture & Benefits

• Comprehensive benefits and perks tailored to regional needs.
• Commitment to a diverse and inclusive work culture.
• Opportunity to work on cutting-edge data and AI infrastructure.
• Focus on equitable compensation and professional growth.