Vice President AI ML Engineering

TL;DR

Vice President, AI/ML Engineering (AI): Designing and implementing GenAI agentic solutions to reduce risk and cost in large-scale production environments with an accent on secure action execution, prompt synthesis, and self-correction loops. Focus on unifying classical ML with agentic AI, building robust guardrails for safety and compliance, and optimizing cost and latency under real-world loads.

Location: Onsite in Menlo Park, California, United States. The expected base salary is for a New York, New York, United States-based position.

Salary: $150,000–$250,000

Company

hirify.global is a leading global investment banking, securities, and investment management firm, founded in 1869.

What you will do

• Design and implement tool-calling agents for GenAI systems, combining retrieval, structured reasoning, and secure action execution, with robust guardrails for safety and compliance.
• Productionize LLMs by building evaluation frameworks for open-source and foundational models, implementing retrieval pipelines, prompt synthesis, and self-correction loops.
• Integrate agents with observability, incident management, and deployment systems to enable automated diagnostics, runbook execution, and post-incident summarization.
• Collaborate directly with production engineers and application teams to translate pain points into AI roadmaps and deliver auditable, business-aligned outcomes.
• Build validator models, adversarial prompts, and policy checks to enforce safety, reliability, and governance, with deterministic fallbacks and rollback strategies.
• Optimize cost and latency via prompt engineering, context management, caching, model routing, and distillation to meet stringent SLOs under real-world load.

Requirements

• Bachelor’s degree (Masters/PhD preferred) in a computational field with 7+ years of experience as an applied data scientist / machine learning engineer.
• 7+ years of software development experience in one or more languages, with strong hands-on experience building and maintaining large-scale Python applications preferred.
• 3+ years designing, architecting, testing, and launching production ML systems, including model deployment, evaluation, and data processing.
• Practical experience with Large Language Models (LLMs), including API integration, prompt engineering, finetuning, RAG, and tool-using agents.
• Solid grasp of applied statistics, core ML concepts, algorithms, and data structures for efficient and reliable solutions.
• Strong analytical problem-solving skills, ownership, and urgency, with the ability to communicate complex ideas and collaborate effectively across global teams.

Nice to have

• Proficiency building and operating on cloud infrastructure (ideally AWS), including containerized services (ECS/EKS), serverless (Lambda), data services (S3, DynamoDB, Redshift), orchestration (Step Functions), model serving (SageMaker), and infra-as-code (Terraform/CloudFormation).

Culture & Benefits

• Work in a meritocracy where you will be given tools to advance your career.
• Access to comprehensive training programs through hirify.global University, covering technical, business, and leadership skills.
• Valuable and competitive benefits and wellness offerings, including US health insurance for eligible full-time and part-time US employees.