Machine Learning Operations Engineer II (AI)

TL;DR

Machine Learning Operations Engineer II (AI): Building and optimizing ML platform infrastructure and tooling for high-impact generative AI and financial applications with an accent on scalability, automation, and developer experience. Focus on Kubernetes orchestration, distributed computing frameworks, and observability for LLMs and agents in production.

Location: Must be based in the United States. Occasional travel to Cambridge, MA or NYC for team meetings required.

Salary: $130,000–$175,000

Company

hirify.global is the AI innovation hub for S&P Global, focused on developing research-driven generative AI, NLP, and machine learning solutions for global business and financial applications.

What you will do

• Iterate on ML processes to build robust, auditable, and scalable tools and frameworks.
• Collaborate with ML engineers to identify pain points and implement effective infrastructure solutions.
• Empower teams with stable tooling for rapid experimentation and production deployment.
• Provide resources and training on MLOps best practices for high-value production systems.
• Evaluate and integrate open-source and third-party solutions into the existing platform ecosystem.
• Monitor production performance and observability for LLMs and Agentic applications.

Requirements

• Must be based in the United States.
• 2+ years of experience in ML infrastructure, MLOps, or ML Engineering.
• Solid experience managing distributed systems with Kubernetes.
• Strong understanding of AWS and managed ML services (EKS, SageMaker, Bedrock).
• Proficiency in Python and familiarity with distributed frameworks like Ray or Airflow.
• Ability to debug complex distributed systems across infrastructure and networking layers.

Nice to have

• Experience with Agentic AI systems and frameworks.
• Experience running workflows on Ray.
• Familiarity with MCP server patterns.

Culture & Benefits

• 100% company-paid medical, dental, and vision insurance premiums.
• Unlimited Paid Time Off (PTO) and 26 weeks of 100% paid Parental Leave.
• 401(k) plan with 6% employer matching.
• Up to $20,000 tuition assistance for degree programs and $4,000/year for professional development.
• Flexible work environment with a focus on productivity and engagement.
• Dog-friendly office in Cambridge with regular catered lunches and bike-share memberships.