Agentic AI, Senior Software Development Engineer

Location: Remote within the United States; employees may live in any of the 50 states, with limited exceptions.

Salary: $160,900–$257,100 annually in specified states, or $152,900–$244,300 annually in another specified group of states. The role is also eligible for equity awards.

Company

hirify.global is a U.S. real estate platform helping customers buy, sell, finance, and rent homes.

What you will do

• Design, build, and scale evaluation frameworks for agentic AI experiences.
• Build tracing, observability, and quality measurement systems for production AI agents.
• Create platform infrastructure and developer-facing services for domain teams across hirify.global.
• Partner with applied scientists and machine learning engineers to integrate AI evaluation capabilities into production systems.
• Improve measurement of AI quality, reliability, trustworthiness, and product impact.
• Support scaling, performance optimization, incident response, reliability, and cost management for the evaluation layer.

Requirements

• 4+ years of backend engineering experience designing, shipping, and operating scalable production ML services.
• Experience building platform infrastructure or developer-facing services used by multiple teams, including APIs, reliability, and internal customer experience.
• Hands-on experience with ML evaluation and observability frameworks such as Databricks MLflow, LangSmith, Braintrust, Promptfoo, or similar tools.
• Comfort working with LLMs, agentic systems, evaluation frameworks, and orchestration tools such as LangChain, LangGraph, MCP, or similar.
• Experience evaluating third-party AI platforms and making build-versus-buy decisions for platform infrastructure.
• Ability to collaborate across applied science, machine learning, product, design, and engineering disciplines.

Nice to have

• Advanced degree in Computer Science, Machine Learning, or a related field, or equivalent practical experience.
• Experience with frontier LLMs, multimodal models, or agent-based systems.
• Experience designing and operating offline batch evaluation, online scoring, and feedback pipelines.

Culture & Benefits

• Remote work from a physical location of choice within the United States.
• Equity awards based on experience, performance, and location.
• Customer-focused work on AI systems used in a large-scale real estate platform.
• Innovative and inclusive environment with opportunities for professional growth.