Machine Learning Engineer - New Grad (AI)

Location: Austin, Texas, United States, or San Jose, California, United States

Base salary: $131,200–$196,800 USD per year

Company

hirify.global develops AI infrastructure, including a full-stack inference platform and RDU-based SambaRack hardware for efficient deployment of advanced models.

What you will do

• Train, evaluate, and tune speculative decoding models, including Dspark/Dflash, Medusa/Eagle-style heads, and multi-token prediction.
• Develop optimization methods such as quantization, sparsity, distillation, pruning, and parameter-efficient fine-tuning while measuring quality, latency, and resource trade-offs.
• Build and evaluate agentic systems for tool calling, multi-step planning, retrieval, and long-context reasoning.
• Design rigorous evaluations and benchmarks, run ablations, and assess model accuracy and quality claims.
• Translate recent research into working implementations and collaborate with AI performance, compiler, runtime, and product teams to ship model improvements.
• Contribute to reinforcement learning, post-training, and reward modeling as the roadmap expands.

Requirements

• B.S. in Computer Science, Electrical Engineering, Mathematics, or a related field.
• Strong Python programming skills.
• Solid foundation in machine learning, linear algebra, probability, and numerical computing.
• Hands-on experience with PyTorch, TensorFlow, or JAX.
• Working knowledge of transformer architectures and the LLM training or inference pipeline.
• Ability to design clean experiments, interpret results honestly, and communicate findings clearly.

Nice to have

• M.S. or Ph.D. in Computer Science, Electrical Engineering, or a related field.
• Research or internship experience in LLM training, post-training, or inference.
• Experience with speculative decoding, distillation, quantization, sparsity, or other model-efficiency techniques.
• Experience building agentic systems, tool-calling pipelines, or LLM evaluation harnesses.
• Familiarity with reinforcement learning or preference optimization, including RLHF, DPO, GRPO, or reward modeling.
• Experience with distributed training frameworks such as FSDP, DeepSpeed, or Megatron, or inference frameworks such as vLLM, SGLang, or TensorRT-LLM.
• Publications at ML venues or meaningful open-source contributions.

Culture & Benefits

• Full-time US employment with base salary, equity, and benefits.
• Medical coverage includes 95% employee premium coverage and 77% dependent premium coverage, plus an employer-contributed HSA.
• Dental, vision, disability, life, AD&D, and flexible spending account options are available.
• Well-being benefits include Headspace, Gympass+, One Medical, and counseling through an Employee Assistance Program.
• hirify.global is an Equal Opportunity/Affirmative Action Employer.

Hiring process

• Submit a separate application form for each position for which you wish to be considered.