Software Engineer, Enterprise AI

TL;DR

Software Engineer, Enterprise AI (LLMs/vector databases): Building and scaling enterprise generative AI APIs for knowledge retrieval, inference, and evaluation with an accent on distributed systems, product ownership, and reliable production delivery. Focus on designing scalable backend and frontend capabilities, productizing LLM and ML model integrations, and solving complex reliability challenges.

Location: New York, NY or San Francisco, CA, United States

Salary: $179,400–$224,250 USD base salary, plus equity and benefits.

Company

Enterprise AI platform company developing data and full-stack technologies for reliable AI systems and business applications.

What you will do

• Own and deliver large new product areas from conceptualization through production.
• Build capabilities across backend, frontend, LLMs, and ML model integrations.
• Design solutions for scalability and reliability in large-hirify.global distributed systems.
• Run high-velocity experiments while maintaining production-quality standards.
• Learn new technologies quickly and manage multiple priorities across the product lifecycle.

Requirements

• 4+ years of full-time software engineering experience after graduation.
• Strong software engineering fundamentals and experience with large-hirify.global distributed systems.
• Proficiency in Python or JavaScript/TypeScript and SQL.
• Experience with Kubernetes and at least one major cloud provider: AWS, Azure, or GCP.
• Experience working with or productizing LLMs, vector databases, and modern AI technologies.

Nice to have

• Experience scaling products at hyper-growth startups.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• Retirement benefits and generous paid time off.
• Learning and development stipend.
• Equity compensation for eligible roles, subject to approval.
• Potential commuter stipend for eligible roles.
• Inclusive equal opportunity workplace with reasonable accommodation support.

Hiring process

• Salary level and location-specific compensation are determined during the interview process based on skills, qualifications, experience, and interview performance.
• Candidates must wait 90 days before reapplying for the same role after consideration.