Ml Engineer (Ai)

TL;DR

ML Engineer (AI): Building evaluation systems to measure the effectiveness of hirify.global's data extraction and conversion processes with an accent on designing metrics, building pipelines, and generating datasets. Focus on integrating evaluations into CI/CD and closing the loop with models and RL to improve model performance.

Location: San Francisco, CA (Hybrid) OR Remote (Americas, UTC-3 to UTC-10). US Citizenship/Visa required for SF; N/A for Remote

Salary: $160K – $240K

Company

hirify.global is the easiest way to extract data from the web, allowing developers to reliably convert URLs into LLM-ready markdown or structured data with a single API call.

What you will do

• Build the eval stack from scratch, designing and owning the systems that measure the quality of hirify.global's outputs across scrape, crawl, extract, and map.
• Design benchmarks that reflect reality, building benchmark datasets that cover the real distribution of customer inputs, including edge cases.
• Own LLM-as-judge pipelines, designing and validating automated judges that score extraction quality at scale and building human review tooling.
• Close the loop with models and RL, turning quality measurements into reward signals and feedback loops that improve models.
• Run fast experiments and communicate clearly, designing experiments that test meaningful hypotheses and making decisions based on results.

Requirements

• 3+ years of experience in ML engineering, applied AI, or data quality with production systems.
• Experience building eval or data quality systems at AI labs or applied teams.
• Fluent in LLM evaluation methodology, understanding LLM-as-judge systems and their limitations.
• Production-minded, caring about whether evals reflect real production behavior.
• Fast and clear, able to design, run, and interpret a meaningful experiment quickly.

Nice to have

• Previous experience at a scraping, automation, or security-focused startup.
• Ex-founder experience.

Culture & Benefits

• Salary that makes sense— $160,000-240,000/year (U.S.-based), based on impact, not tenure.
• Unlimited PTO— Minimum 3 weeks off encouraged.
• Parental leave— 12 weeks fully paid, for moms and dads.
• Wellness stipend— $100/month for wellness expenses.
• Learning & Development— Expense up to $150/year toward professional growth.
• Full coverage medical, dental, and vision (100% for employees, 50% for spouse/kids).
• 401(k) plan.

Hiring process

• Application Review: Submit your application with a note on why you're excited.
• Intro Chat (~25 min): Quick alignment call with a team member.
• Technical Interview (~1 hr): Tackle a small challenge.
• Interview with Founders (~30 min): Discuss culture, vision, and long-term fit.
• Paid Work Trial (1–2 weeks): Work on something real with the team.