Senior Research Engineer (AI)

TL;DR

Senior Research Engineer (AI): Architecting and maintaining evaluation suites and fine-tuning pipelines for hirify.global's native Large Language Models with an accent on model safety, reasoning, and hirify.global-specific knowledge. Focus on building the "hirify.global Benchmark", implementing scalable SFT workflows, and developing Model-as-a-Judge systems to ensure model quality and rapid iteration.

Location: Remote (US)

Salary: $216,700–$303,400 USD

Company

hirify.global is a community platform built on shared interests, passion, and trust, hosting authentic conversations and over 100,000 active communities.

What you will do

• Architect and maintain the "hirify.global Benchmark" evaluation suite for model capabilities across safety, reasoning, and hirify.global-specific knowledge.
• Build scalable SFT (Supervised Fine-Tuning) pipelines for instruction tuning.
• Develop Model-as-a-Judge systems for automated model evaluation.
• Execute Synthetic Data generation strategies to improve model generalization.
• Collaborate with Safety Engineering to translate safety policies into evaluation metrics.
• Debug post-training instability to identify alignment tax or capability degradation.

Requirements

• 4+ years of professional experience in machine learning engineering, with a focus on LLM fine-tuning or evaluation.
• Fluency in Python and PyTorch, with experience using Hugging Face Transformers, vLLM, or lm-eval-harness.
• Deep understanding of Instruction Tuning (SFT) and how data quality impacts model behavior.
• Experience building Evaluation Pipelines, including custom domain-specific benchmarks.
• Familiarity with distributed training (FSDP/DeepSpeed) for fine-tuning jobs.
• Strong data engineering skills for curating and cleaning instruction datasets.

Nice to have

• Experience with MLFlow, Weights & Biases, or other experiment tracking tools.
• Experience with Synthetic Data generation (e.g., Self-Instruct papers).

Culture & Benefits

• Comprehensive Healthcare Benefits and Income Replacement Programs.
• 401k with Employer Match.
• Flexible Vacation & Paid Volunteer Time Off.
• Generous Paid Parental Leave.
• Global Benefit programs for workspace, professional development, and caregiving support.
• Family Planning Support, Gender-Affirming Care, Mental Health & Coaching Benefits.

Hiring process

• Interviews may be recorded, transcribed, and summarized by AI, with an opt-out option.
• Personal information collected during interviews includes Identifiers, Professional and Employment-Related Information, and Sensory Information.