Llm Ops Engineer (AI)

TL;DR

Llm Ops Engineer (AI): Managing the lifecycle of Large Language Models from development to deployment, monitoring, and continuous improvement with an accent on fine-tuning pre-trained models and scaling infrastructure. Focus on implementing content moderation systems, detecting and mitigating bias in model outputs, and ensuring regulatory compliance in AI systems.

Location: Denver, Colorado or Raleigh, NC and candidates should reside within reasonable commuting distance, as this role requires on-site presence at least three days per week.

Salary: $140,000 to $180,000

Company

hirify.global is on a mission to Raise The Bar™️ for the legal profession by delivering transformational and globally-trusted solutions to law firms and corporate legal teams worldwide.

What you will do

• Fine-tune pre-trained models and curate datasets for training.
• Develop and manage APIs for model serving and scale infrastructure.
• Track performance and quality metrics, optimizing costs.
• Create and maintain golden datasets for benchmark testing.
• Design and implement user feedback collection systems.
• Implement content moderation systems and detect bias in model outputs.

Requirements

• Experience with LLM development, fine-tuning, and deployment.
• Strong programming skills, particularly in Python.
• Experience with Kubeflow, Apache Airflow, MLFlow, or other LLM Pipeline technology.
• Experience with Azure OpenAI, AWS Sagemaker, and/or Vertex AI.
• Understanding of machine learning operations and MLOps principles.
• Familiarity with ISO 27001 and SOC2 Certification

Culture & Benefits

• Emphasize helping each other grow and doing the right thing always.
• Focus on tools that matter to the difference-makers in the legal world and amplifying their impact.
• Offer a dynamic and diverse work environment where employees can grow, listen, empathize, and problem-solve together.
• Provide health insurance, retirement savings plans, generous paid time off, and a supportive work-life balance.
• Provide career paths and opportunities for professional development.