Backend Engineer (AI)

TL;DR

Backend Engineer (AI): Building and optimizing high-scale distributed systems for an AI-driven investment platform with an accent on information retrieval, agentic workflows, and performance at scale. Focus on architecting robust backend services, implementing universal indexing systems, and ensuring low-latency execution for complex LLM-powered analysis.

Location: On-site in NYC or San Francisco

Salary: $160,000–$300,000

Company

Hebbia is an AI platform for investors and bankers that powers investment decisions for the world’s largest asset managers by transforming how capital is deployed and risk is managed.

What you will do

• Own critical system components and translate complex requirements into robust, scalable solutions.
• Build and iterate on high-scale document indexing systems to enable constant-time latency.
• Architect performance-tuning solutions to maximize throughput across millions of documents.
• Integrate product experience with powerful distributed systems and agentic solutions.
• Provide technical leadership and mentorship to junior engineers.

Requirements

• 5+ years of backend software engineering experience at a venture-backed startup or top technology firm.
• Proficiency in building backend and API systems using Python, Java, or Go.
• Extensive experience with cloud platforms such as AWS.
• Working experience with Kafka, ElasticSearch, PostgreSQL, or Redis.
• Must be able to work on-site in NYC or San Francisco.
• Strong academic background in Computer Science, Data Science, or Statistics.

Nice to have

• Experience building agentic systems or LLM-enabled products.
• Frequent user of AI development tools like Cursor or Claude Code.

Culture & Benefits

• Competitive equity package with significant upside potential.
• Comprehensive insurance including Medical, Dental, and Vision.
• 401K retirement plan.
• Unlimited PTO policy.
• Daily catered lunches and dinner credits for late work.
• Generous parental leave and fertility benefits.