Machine Learning Infrastructure Engineer (AI)

TL;DR

Machine Learning Infrastructure Engineer (AI): Designing and scaling core infrastructure for machine learning and self-hosted LLM applications with an accent on low-latency serving and high-throughput GPU inference. Focus on building distributed training pipelines, productionalizing novel ML architectures, and ensuring system reliability at consumer-scale loads.

Location: Must be based in the US and live within commuting distance of New York, Seattle, Los Angeles, or San Francisco hubs

Salary: $245,000 - $345,000 per year

Company

hirify.global is the largest livestream shopping platform in North America and Europe, enabling users to buy, sell, and discover items across hundreds of categories.

What you will do

• Own infrastructure powering AI/ML models for growth, recommendations, trust and safety, fraud, and seller tooling.
• Prototype, deploy, and productionalize novel ML architectures that directly shape user experience and marketplace dynamics.
• Design and scale inference infrastructure capable of serving large models with low latency and high throughput.
• Build distributed training and inference pipelines leveraging GPUs and both model and data parallelism.
• Collaborate with ML scientists to bring cutting-edge models into production.

Requirements

• 4+ years of professional experience developing machine learning systems and algorithms.
• 3+ years of software engineering experience building production systems for consumer-scale loads.
• 1+ years of professional experience developing software in Python.
• Experience with operational, search, and key-value databases (PostgreSQL, DynamoDB, Elasticsearch, Redis).
• Familiarity with AWS (Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS), Apache Kafka, and Flink.
• Must be based in the US and live within commuting distance of New York, Seattle, Los Angeles, or San Francisco hubs

Culture & Benefits

• Flexible time off policy and company-wide holidays, including spring and winter breaks.
• Comprehensive health insurance options including Medical, Dental, and Vision.
• Work from home support with home office setup and monthly cell phone/internet allowances.
• 401k retirement offering with employer match up to 4% of base salary.
• 16 weeks of paid parental leave.
• Monthly allowance for dogfooding the app to ensure a deep understanding of the product.