Lead/Senior Inference Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Location: Remote within the United States or Canada; listed locations include Eagan, Minnesota; Frisco, Texas; New York, New York; Ann Arbor, Michigan; and Toronto, Ontario. Work from anywhere is available for up to 8 weeks per year.
Base compensation: $127,400–$236,600 USD for eligible US locations; $140,000–$175,000 CAD for Ontario, Canada. The role may also be eligible for an annual bonus.
Company
Labs is the research and development division of , building AI products and trusted software for legal, tax, accounting, compliance, government, and media professionals.
What you will do
- Build and operate the model-serving infrastructure supporting production traffic for the Thomson model family and benchmark models.
- Implement inference optimizations such as batching, caching, and quantization to improve cost, latency, and quality.
- Improve platform observability and maintain reliability across peak load, scaling, disaster recovery, and new product integrations.
- Implement ISO 27001 controls and evidence, cost tracking and attribution, and GPU-capacity contingency plans.
- Work with training and evaluation teams to deploy new model releases and document cost, latency, and reliability tradeoffs.
- Establish on-call, incident review, onboarding, and engineering practices as an early member of a newly formed team.
Requirements
- Hands-on infrastructure engineering experience with Kubernetes or a similar platform, including production system ownership.
- Experience operating model services across peak load, scaling, disaster recovery, and operational excellence.
- Direct experience with model-serving infrastructure and/or inference optimization for large models.
- Large-scale distributed systems experience, including production scaling and reliability.
- Ability to debug distributed systems and production incidents under real traffic.
- Track record of designing, building, and operating software end to end in production.
- Ability to champion and enforce engineering best practices while responding to dynamic product requirements.
- Ability to work autonomously as an early lead engineer and mentor and grow team members.
Nice to have
- Experience with LLM-serving stacks such as vLLM, TensorRT-LLM, Triton, SGLang, or similar.
- Exposure to GPU-cluster capacity planning or multi-region and multi-cloud deployment.
- Experience with regulated or compliance-heavy production environments such as ISO 27001 or SOC 2.
- Familiarity with systems programming languages such as Rust or Go.
- Experience with systems-level optimization, including rate limiting, routing, and bottleneck analysis across networking, hardware, and lower-level software.
Culture & Benefits
- Remote work with flexible workplace policies and work-from-anywhere flexibility for up to 8 weeks annually.
- Flexible vacation, paid holidays, sick and safe paid time off, two company-wide mental health days, parental leave, and sabbatical leave.
- Health, dental, vision, disability, life insurance, retirement savings with company match, health and flexible spending accounts, and employee assistance resources.
- Tuition reimbursement, professional development programs, fitness reimbursement, employee incentive programs, and an employee stock purchase plan.
- Paid volunteer days and opportunities for pro-bono consulting and environmental, social, and governance initiatives.
Hiring process
- This is a proactive recruitment posting that may support current or future openings.
- uses AI to support parts of recruitment unless the candidate opts out; a human makes the final consideration decision.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →