Member Of Engineering (Pre-training / Data Research) (AI)

TL;DR

Member Of Engineering (AI): Developing and optimizing high-quality pretraining datasets for frontier LLMs with an accent on synthetic data generation and data mix optimization. Focus on building trillion-scale data pipelines and conducting data ablations to improve model capabilities.

Location: Remote (Must be based in EMEA or the US East Coast)

Company

hirify.global is building AGI by accelerating software development through agentic systems, coding assistants, and frontier models.

What you will do

• Improve pretraining dataset quality through synthetic data generation and data mix optimization.
• Design and implement complex, high-diversity data pipelines for trillion-scale datasets.
• Collaborate with Pretraining, Posttraining, Evals, and Product teams to define data needs mapping to model capabilities.
• Conduct and analyze data ablations and training experiments to obtain quantitative insights.
• Stay current with the latest research in LLM dataset design and pretraining.

Requirements

• Strong background in machine learning and engineering with excellent Python skills.
• Deep understanding of transformer architectures, scaling laws, and LLM learning processes.
• Experience building trillion-scale pretraining datasets, including curation, deduplication, and tokenization.
• Experience with evals tracking and working with large-scale GPU clusters and distributed data pipelines.
• Must be based in EMEA or the US East Coast.

Nice to have

• Author of scientific papers on applied deep learning, LLMs, or source code generation.

Culture & Benefits

• Fully remote work with flexible hours and 37 days of annual vacation and holidays.
• Health insurance allowance for employees and their dependents.
• Company-provided equipment and allowances for home office, well-being, and learning.
• Diverse, inclusive, people-first culture with frequent team get-togethers.

Hiring process

• Introductory call with a Founding Engineer.
• Technical interviews with Members of Engineering.
• Team fit call with the People team.
• Final interview with a Founding Engineer.