Senior AI Scientist (AI)

TL;DR

Senior AI Scientist (AI): Designing and training large-scale transformer and hybrid foundation models for the automotive world with an accent on model architecture, training stability, and scaling laws. Focus on implementing advanced transformer variants, optimizing distributed training, and refining alignment via RLHF and DPO.

Location: Remote (USA)

Salary: $123,500 - $197,600 USD

Company

Global industry leader in creating unique voice assistant experiences for the automotive world, working with leading automakers like BMW, Audi, and Ford.

What you will do

• Design and train large-scale transformer and hybrid foundation models across text and multimodal paradigms.
• Own model architecture choices, including Attention variants, RoPE, ALiBi, GQA, and Mixture-of-Experts (MoE).
• Diagnose and resolve training instabilities at scale and navigate compute vs data tradeoffs.
• Optimize training dynamics using AdamW, Lion, and Adafactor, and manage learning-rate schedulers.
• Execute large-scale distributed training using FSDP, ZeRO-3, and tensor/pipeline parallelism.
• Experiment with loss functions and alignment techniques including next-token prediction, RLHF, DPO, and GRPO.

Requirements

• Strong fundamentals in deep learning and representation learning.
• Experience building transformer architectures from first principles.
• Proven ability to apply and validate scaling laws (e.g., Chinchilla-style tradeoffs).
• Expertise in distributed training using mixed precision (bf16, fp8) and gradient checkpointing.
• Must be based in the USA.

Culture & Benefits

• Generous compensation package including annual bonus opportunities and equity awards for certain levels.
• Comprehensive insurance coverage (medical, dental, vision, life, and disability).
• Paid time off and paid holidays.
• Company contribution to the RRSP (Registered Retirement Savings Plan).
• Remote and/or hybrid work flexibility depending on the position.