Backend Software Engineer (AI)

TL;DR

Backend Software Engineer (AI): Designing and implementing secure, robust, and scalable services for speech processing and distributed compute orchestration with an accent on performance optimization and low-latency systems. Focus on building reusable code, debugging complex system interactions, and integrating advanced AI tools into daily development workflows.

Location: Must be based in the USA (Remote)

Salary: $150,000 – $220,000 base salary + equity + 10% annual bonus

Company

Deepgram is a leading Voice AI platform providing real-time speech-to-text and text-to-speech APIs for over 1,300 organizations.

What you will do

• Improve core inference services, focusing on networking, audio transcoding, and latency/memory optimization.
• Develop processes for measuring and maximizing system performance.
• Debug complex system issues involving networking, scheduling, and high-performance computing.
• Rapidly customize backend services to meet specific customer requirements.
• Partner with Product teams to design and implement new features end-to-end.

Requirements

• 3+ years of industry experience.
• Proficiency in Rust (or C/C++) and competence in Python.
• Comprehensive experience with UNIX-style systems.
• Strong understanding of version control (Git).
• Excellent communication and organizational skills.
• Must be based in the USA.

Nice to have

• Experience with modern machine learning frameworks like Torch.
• Implementation knowledge of CNNs, RNNs, and transformers.
• Experience with audio processing.

Culture & Benefits

• AI-first culture where active use of AI tools is core to performance and innovation.
• Fast-paced, impact-driven environment.
• Equity and bonus opportunities.
• Focus on continuous learning and rapid adaptation.