Senior Principal Model Bring-up Engineer (AI)

Location: Austin, Texas, United States, or San Jose, California, United States

Base salary: $208,000–$312,000 USD per year

Company

hirify.global develops AI infrastructure and a full-stack inference platform based on RDU dataflow accelerators and SambaRack rack-scale hardware.

What you will do

• Bring up dense, mixture-of-experts, and hybrid Mamba/attention LLMs from model adaptation through production serving.
• Convert checkpoints, map models across chips and hosts, compile them, and validate numerical correctness against reference implementations.
• Build shared inference modules for continuous batching, paged KV caching, prompt caching, chunked and incremental prefill, dynamic tensor shapes, speculative decoding, FP8/FP4, and tensor/expert parallelism.
• Debug issues across models, compilers, and hardware, landing fixes in reusable shared components.
• Own a model family from first compile to served and merged, while shortening a long-running team workflow.

Requirements

• Bachelor’s degree in Computer Science, Electrical Engineering, or a related field.
• 8+ years of industry experience in ML systems, inference, or compiler engineering.
• Strong Python and PyTorch internals experience, plus some C++.
• Deep transformer-inference knowledge covering KV caching, GQA, sliding-window attention, MoE routing, prefill versus decode, batching, and speculative decoding.
• Hands-on experience with accelerator bring-up, ML compilers such as MLIR, XLA, TVM, Triton, or torch-mlir, or inference engines such as vLLM, SGLang, or TensorRT-LLM.
• Rigor in numerical debugging and comfort with Bazel, Slurm, and large monorepos.
• Clear writing and evidence-backed claims.

Nice to have

• Master’s or Ph.D. in Computer Science, Electrical Engineering, or a related field.
• Experience with dataflow or spatial compilers, kernel DSLs, FP8/FP4 inference, Mamba and SSMs, expert parallelism, multi-agent AI engineering workflows, or open-source inference/compiler contributions.

Culture & Benefits

• Full-time US employment with base salary, equity, and benefits.
• Medical insurance with 95% employee premium coverage and 77% dependent premium coverage, plus employer-funded HSA contributions.
• Dental, vision, disability, life, AD&D, and flexible spending account options.
• Well-being benefits including Headspace, Gympass+, One Medical, and counseling through an Employee Assistance Program.
• Equal Opportunity/Affirmative Action employer.

Hiring process

• Submit a separate application form for each position for which you wish to be considered.