AI Agent Operations Consultant

Location: Remote, United States; light travel required.

Base salary: $85,000–$110,000 USD per year, plus an annual bonus of up to 5%. Pay depends on location, market conditions, and job-related skills and experience.

Company

hirify.global provides mortgage accounting software built on Microsoft Dynamics 365 Business Central for mortgage banks, banks, and credit unions. It is part of Banyan Software, which acquires and grows specialized software businesses worldwide.

What you will do

• Operate Luna 1.0 in production and Luna 2.0 during rollout, monitoring agent quality, task completion, escalations, adoption, and usage growth.
• Run continuous AI training using the knowledge, documentation, and skills that Luna relies on, and influence how it responds, escalates, and hands off to people.
• Use telemetry from Application Insights and Power Platform to identify weak answers, bugs, enhancement requests, and documentation gaps.
• Turn findings into prioritized tasks for Product and Development, automate the feedback loop where possible, and report adoption, experience quality, and task-completion metrics.
• Enable customers to configure and train Luna through customer- and user-level instructions, webinars, guides, and one-on-one support.
• Connect Customer Success, Product, Development, and Implementation while supporting interoperability between Luna and customers’ other AI tools and systems.

Requirements

• 5+ years of experience in enterprise software, including real ERP experience.
• Customer Success, support, or consulting background in an ERP environment.
• Proven experience running customer-facing AI agents; internal AI productivity tools alone do not meet this requirement.
• Hands-on experience with agentic AI workflows, including agent-to-agent handoffs or AI embedded in business workflows.
• Working knowledge of APIs and integrations, including the ability to support and troubleshoot them without being a developer.
• Clear communication skills for turning technical findings into action for customers and internal teams.

Nice to have

• Dynamics 365 Business Central experience; Finance & Operations or NAV experience also counts.
• Experience as a BC/NAV functional-technical consultant.
• Accounting or finance process knowledge.
• Experience in mortgage, financial services, or another regulated environment.
• Working knowledge of Copilot Studio, Power Platform, Application Insights, or similar telemetry tools.
• Familiarity with retrieval/RAG, tool calling, structured outputs, multi-step orchestration, MCP, Azure AI Search, Logic Apps, Entra ID, and the wider Microsoft AI stack.

Culture & Benefits

• Full-time individual contributor role reporting to the VP of Customer Success & Engagement.
• Remote work in the United States with light travel.
• Opportunity to help an AI-first company make Luna accurate, intuitive, trusted, and widely adopted.
• Annual bonus opportunity of up to 5%.
• Inclusive workplace committed to equal employment opportunities and accessibility.