Lead Engineer, ML Network Stack (AI Engineering)

TL;DR

Lead Engineer, ML Network Stack (AI Engineering): Leading a team that develops the network stack for EC2 distributed AI/ML systems with an accent on supporting frameworks and communication libraries including NCCL, NVSHMEM, NIXL, NCCL GIN, and Perplexity kernels. Focus on automating the delivery of software to customers and inventing automatic mechanisms to alert developers to functional and performance regressions.

Location: Must be based in Cupertino, CA or Seattle, WA, USA

Salary: 193,300.00 - 261,500.00 USD (Cupertino, CA), 168,100.00 - 227,400.00 USD (Seattle, WA) annually

Company

hirify.global AI develops hardware and software components that are critical building blocks for EC2 infrastructure, optimizing the AWS customer experience.

What you will do

• Lead a team that builds and maintains infrastructure for monitoring and reporting on functionality and performance of massive testing workloads at scale.
• Automate the delivery of software to customers using internal hirify.global CI/CD tools, Linux, and public AWS products.
• Write Python code to spool up large clusters and run benchmarks and applications for ML and HPC workloads.
• Use AWS Managed Grafana and Athena to digest performance data and create dashboards for developers and stakeholders.
• Invent automatic mechanisms to alert developers to functional and performance regressions.
• Manage the complexity of infrastructure covering many instance types, software stacks, and Linux operating systems.

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• 3+ years as a mentor, tech lead or leading engineering teams
• 3+ years experience in SW/HW Co-Design

Nice to have

• Bachelor's degree in computer science or equivalent
• Experience creating automated dashboards and visualization (such as Grafana)

Culture & Benefits

• Value work-life harmony and strive for flexibility as part of working culture.
• Offer endless knowledge-sharing, mentorship, and career-advancing resources.
• Provide comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave.