Software Engineer, Machine Learning Infrastructure (AI)

TL;DR

Software Engineer, Machine Learning Infrastructure (AI): Designing and scaling core infrastructure for machine learning and self-hosted LLM applications with an accent on low-latency model serving and distributed training. Focus on building high-throughput GPU inference pipelines and productionalizing novel ML architectures to enhance marketplace dynamics.

Location: Must be based in the US and live within commuting distance of the New York, Seattle, Los Angeles, or San Francisco hubs

Salary: $190,000 – $300,000 + Equity

Company

The largest livestream shopping platform in North America and Europe, enabling users to buy, sell, and discover items across hundreds of categories.

What you will do

• Own AI/ML infrastructure across critical surfaces including growth, recommendations, trust and safety, and fraud.
• Prototype, deploy, and productionalize novel ML architectures that shape user experience.
• Design and scale inference infrastructure for large models with low latency and high throughput.
• Build distributed training and inference pipelines leveraging GPUs and model/data parallelism.
• Develop and maintain systems for self-hosted large language model (LLM) applications.

Requirements

• 4+ years of professional experience developing machine learning systems and algorithms.
• 3+ years of software engineering experience building production systems for consumer-scale loads.
• 1+ years of professional experience with Python.
• Experience with operational, search, and key-value databases (PostgreSQL, DynamoDB, Elasticsearch, Redis).
• Familiarity with AWS ecosystem (Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS) and stream processing (Kafka, Flink).
• Must live within commuting distance of New York, Seattle, Los Angeles, or San Francisco hubs.

Culture & Benefits

• Flexible time off policy including spring and winter breaks.
• Comprehensive health insurance (Medical, Dental, Vision) and 401k with employer match up to 4%.
• Work-from-home support including home office setup and monthly phone/internet allowances.
• Family planning benefits including adoption, fertility expenses, and 16 weeks of paid parental leave.
• Monthly allowance to dogfood the app and explore the marketplace.