ML Research Engineer (ML Systems)

TL;DR

ML Research Engineer (ML Systems): Building and optimizing a distributed framework for LLM training and inference with an accent on system performance and data curation. Focus on profiling training frameworks, integrating SOTA technologies, and accelerating research development.

Location: San Francisco, CA; Seattle, WA; New York, NY

Salary: $189,600 - $237,000 USD

Company

hirify.global provides high-quality data and full-stack technologies that power the world's leading AI models for enterprises and governments.

What you will do

• Build, profile, and optimize training and inference frameworks.
• Collaborate with ML teams to accelerate research and develop next-generation models and data curation.
• Research and integrate state-of-the-art technologies to optimize ML systems.

Requirements

• Strong excitement about system optimization.
• Experience with multi-node LLM training and inference.
• Experience developing large-hirify.global distributed ML systems.
• Proficiency in frameworks and tools such as CUDA, PyTorch, transformers, and flash attention.
• Strong written and verbal communication skills.

Nice to have

• Expertise in post-training methods including instruction tuning, RLHF, tool use, reasoning, agents, and multimodal.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• Equity-based compensation and retirement benefits.
• Learning and development stipend.
• Generous PTO and commuter stipend.