Staff Machine Learning Engineer, AI Agent Platform (AI)

Location: New York City, NY, United States

Annual salary: $115,000–$260,000

Company

hirify.global is a large United States auto insurer and a member of the Berkshire Hathaway family of companies.

What you will do

• Architect scalable, multi-tenant backend systems for AI agent configuration, evaluation, workflow simulation, synthetic data generation, MCP registries, A2A communication, and guardrail enforcement.
• Build an enterprise AI agent skill ecosystem with authoring, publishing, discovery, versioning, quality scoring, security vetting, approval workflows, and progressive loading.
• Develop production-grade agent harnesses for tool dispatch, context management, error recovery, session state, and sub-agent coordination.
• Implement context engineering systems including memory hierarchies, RAG pipelines, scratchpads, context compaction, and dynamic skill and tool loading.
• Create LLM observability frameworks with distributed tracing, token usage, latency profiling, hallucination detection, behavior auditing, and skill execution monitoring.
• Lead a sub-team, mentor engineers, establish engineering standards, and collaborate with data science, engineering, and product teams.

Requirements

• Bachelor’s degree in computer science, engineering, or a related field; an advanced degree is highly desirable.
• 6+ years designing, implementing, and maintaining production multi-tenant AI/ML systems.
• 6+ years working with cloud platforms such as Azure or AWS and backend technologies including Kubernetes, Temporal, OpenSearch, PostgreSQL, Redis, and Neo4j.
• Deep proficiency in Python, Java, or Go, with strong knowledge of Docker, Prometheus, and OpenTelemetry.
• Experience with AI/ML and agentic frameworks including TensorFlow, PyTorch, LangGraph, CrewAI, or AutoGen.
• Demonstrated experience mentoring engineers, leading technical initiatives, and communicating with diverse stakeholders.

Nice to have

• Experience with harness engineering, AI agent skill registries or marketplaces, MCP, and A2A.
• Experience with LLM observability tools such as LangSmith, Langfuse, or Arize Phoenix.
• Experience with prompt-injection defense, PII scanning, skill-level security auditing, multi-agent orchestration, and open-source or proprietary LLMs.
• Experience using AI coding tools such as Cursor, Claude Code, or GitHub Copilot.

Culture & Benefits

• Personalized development programs, mentorship, and certification assistance.
• Inclusive and collaborative culture focused on shared success.
• Competitive pay, benefits, and flexibility supporting employee well-being.
• hirify.global will consider sponsoring a new qualified applicant for employment authorization.