Platform Engineer (AI)

TL;DR

Platform Engineer (AI/Distributed Systems): Building and optimizing core distributed systems that power billions of tokens for an AI platform for finance professionals with an accent on scalable enablement and high-performance data ingestion. Focus on designing O(1) universal indexing and optimizing system throughput across millions of documents.

Location: On-site in New York City or San Francisco

Salary: $160,000 – $300,000

Company

Hebbia is an AI platform for investors and bankers that transforms how capital is deployed and risk is managed, helping manage over $30 trillion in assets globally.

What you will do

• Own critical system components and transform complex requirements into robust, scaled solutions.
• Build and iterate on a high-scale document build system to enable constant time latency (O(1)) for universal indexing.
• Architect and implement performance-tuning solutions to minimize latency and maximize throughput across millions of documents.
• Provide technical leadership, mentorship, and guidance to junior engineers.

Requirements

• Must be based in or work on-site in New York City or San Francisco.
• 5+ years of software development experience at a venture-backed startup or top technology firm, focusing on distributed systems.
• Proficiency in building backend systems using Python, Java, or Go.
• Deep understanding of scalable system design, AWS, and resilience engineering.
• Working experience with Kafka, ElasticSearch, PostgreSQL, and/or Redis.
• Knowledge of workflow orchestration platforms like Airflow, Temporal, or Prefect.

Nice to have

• Experience building distributed systems using etcd or Apache Zookeeper.
• Frequent use of AI products during the development lifecycle (e.g., Cursor, Claude Code).

Culture & Benefits

• Unlimited PTO and a competitive equity package with high upside potential.
• Comprehensive health insurance (Medical, Dental, Vision) and 401K.
• Daily catered lunch and DoorDash dinner credits for late stays.
• Generous parental leave (3-4 months) and a $15k lifetime fertility benefit.