Member of Technical Staff, MM Inference (AI)

TL;DR

Member of Technical Staff, MM Inference (AI): Building large-scale inference infrastructure and efficient serving of multimodal generative models with an accent on model architecture, data curation, and training/inference infrastructure. Focus on achieving optimal serving latency and throughput, driving best practices, and shaping the roadmap for software and hardware components in AI.

Location: New York, United States. Hybrid work is required, with employees expected to work from a designated Microsoft office at least four days a week if living within 50 miles (U.S.) of that location.

Salary: $139,900–$331,200 per year

Company

hirify.global is dedicated to advancing Copilot and other consumer AI products and research, building foundational models for responsible and efficient artificial general intelligence.

What you will do

• Develop and maintain the inference engine for multimodal generative models.
• Develop and maintain model deployment pipelines for various product lines.
• Benchmark, profile, and tune model inference performance using novel research and engineering techniques.
• Gather data and insights to develop the multimodal inference roadmap.
• Drive best practices, influence architectural decisions, and shape the roadmap for relevant software and hardware components.
• Work closely with research scientists and product engineers to achieve optimal serving latency and throughput.

Requirements

• Bachelor’s Degree in Computer Science or related technical field.
• 6+ years of technical engineering experience with coding in C, C++, C#, Java, JavaScript, or Python.
• Ability to work from a designated Microsoft office in New York, United States for at least four days a week if residing within 50 miles of the office.

Nice to have

• Master’s Degree in Computer Science or related technical field and 8+ years technical engineering experience OR Bachelor’s Degree with 12+ years experience.
• Experience in leading technical projects and supporting architectural decisions.
• Experience with generative AI.
• Experience with distributed computing.

Culture & Benefits

• Embrace a growth mindset, innovate to empower others, and collaborate to achieve shared goals.
• Foster a culture of inclusion based on values of respect, integrity, and accountability.
• Focus on empowering every person and organization on the planet to achieve more.
• Work in a fast-paced environment, creating world-class consumer experiences and products.
• Join a newly formed organization dedicated to advancing Copilot and consumer AI products and research.