Senior Software Engineer (ML Infrastructure)

TL;DR

Senior Software Engineer (ML Infrastructure): Design and build scalable backend infrastructure for real-time, multi-language speech AI systems with an accent on distributed systems, ML model deployment, and real-time data streaming. Focus on architecting fault-tolerant services, improving system observability, and collaborating closely with ML researchers and product teams.

Location: Mountain View, CA, United States

Salary: $185,000–$230,000 USD per year

Company

hirify.global is a leading AI-driven platform for meeting transcription, summarization, and collaboration, with over 1 billion meetings transcribed worldwide.

What you will do

• Design, build, and operate backend services powering real-time, multi-language ASR and speaker identification features.
• Architect scalable, fault-tolerant infrastructure supporting low-latency ML workflows across databases, queues, and pub/sub systems.
• Partner with ML teams to deploy and monitor models for real-time and batch inference.
• Improve system observability, reliability, and performance for large-scale speech data ingestion and streaming.
• Contribute to platform architecture evolution including microservices, Kubernetes orchestration, and API integrations.
• Collaborate on developer experience, CI/CD pipelines, and automated testing for ML-backed services.

Requirements

• Location: Must be able to work onsite in Mountain View, CA, United States
• 5+ years experience designing and building scalable backend and distributed systems.
• Fluent in Python; experience with C++ is a plus.
• Strong understanding of data structures, algorithms, distributed systems, and operating systems.
• Experience with SQL & NoSQL databases, queuing systems, and pub/sub solutions.
• Experience or strong interest in ML infrastructure and MLOps.

Nice to have

• Experience with real-time streaming frameworks like Kafka, Pulsar, Flink.
• Hands-on experience with container orchestration (Kubernetes, ECS).
• Familiarity with SDK integrations or developer platform design.
• Experience building or optimizing speech/voice AI pipelines.

Culture & Benefits

• Inclusive and accessible workplace committed to diversity.
• Reasonable accommodations for candidates with disabilities during hiring.
• Comprehensive total rewards package beyond base salary.