Member Of Technical Staff, Infrastructure (AI)

Location: Boston, United States; hybrid

Company

hirify.global, spun out of MIT CSAIL, builds general-purpose AI systems optimized for efficient deployment across data center accelerators and on-device hardware.

What you will do

• Design and build benchmark suites covering inference performance, model quality, and knowledge evaluation across hardware targets.
• Run technical verifications for external partners, compare solutions against benchmarks, identify gaps, and communicate findings.
• Port models such as LFM2 across runtimes and frameworks and verify numerical correctness end to end.
• Maintain and extend the inference engine layer built on llama.cpp, ONNX, and MLX as new model architectures emerge.
• Make benchmark results explainable, verifiable, and reproducible for internal teams and external partners.

Requirements

• Hands-on experience with at least one inference framework such as llama.cpp, ONNX Runtime, or MLX, including internals and modification.
• Experience designing and building benchmarking pipelines with rigorous methodology, validation, and reproducibility.
• Strong C++ and Python skills in performance-sensitive contexts.
• Solid understanding of inference fundamentals, including quantization, decoding strategies, memory layout, and their tradeoffs.

Nice to have

• Experience porting models across runtimes and verifying numerical correctness.
• Experience working with external partners or clients in technical validation or evaluation.
• Familiarity with edge inference targets and their constraints.

Culture & Benefits

• Work closely with research, product, and external engineering teams.
• Medical, dental, and vision premiums fully covered for employees and dependents.
• 401(k) matching of up to 4% of base pay.
• Unlimited paid time off and company-wide Refill Days.
• Competitive base salary and equity participation.