AI Engineer

Location: Remote within the United States; hybrid opportunity if based in Denver, Colorado

Salary: $120K–$170K annually, plus bonus and benefits

Company

hirify.global develops CommsCoach, an AI-powered platform that supports 9-1-1 and emergency communications centers through automated quality assurance, training, and real-time call evaluation.

What you will do

• Design, build, and maintain automated evaluation pipelines for production LLM applications.
• Develop prompt engineering strategies, compare LLMs, and measure changes using quantitative evaluation methods.
• Build offline evaluation datasets and regression testing frameworks to track AI performance over time.
• Analyze production AI behavior with Python, SQL, and statistical techniques, including error analysis and experiment design.
• Create dashboards and reporting for AI quality, reliability, and performance metrics.
• Partner with engineering, product, data science, and data engineering teams to deploy and monitor improvements and establish Responsible AI practices.

Requirements

• Must pass FBI fingerprinting and background checks in multiple states.
• U.S. citizenship is strongly preferred.
• 3+ years of experience in software engineering, machine learning, data science, or a related technical field.
• Strong Python development and SQL skills, including analysis of large datasets.
• Experience designing evaluation metrics, interpreting AI model performance, and applying statistical methods such as hypothesis testing and experiment design.
• Experience supporting production LLM or generative AI applications, prompt engineering, and systematic prompt evaluation.

Nice to have

• Experience with AI evaluation or observability platforms such as Langfuse, LangSmith, MLflow, or Label Studio.
• Experience with AWS services including Bedrock, Lambda, S3, Glue, or SageMaker.
• Experience building dashboards with Tableau, Sisense, Power BI, or similar tools.
• Knowledge of Responsible AI principles and evaluation methodologies.

Culture & Benefits

• Health, dental, and vision benefits.
• Flexible time off.
• Opportunity to build AI systems supporting first responders and emergency communications professionals.
• Work on LLM technologies, Responsible AI, and technically challenging public safety problems.
• Collaborate across AI, engineering, product, and data science functions.