Open Source AI Engineer (TypeScript)

TL;DR

Open Source AI Engineer (TypeScript/LLM Observability): Developing open-source libraries and APIs for monitoring and evaluating LLM output with an accent on community-driven development and the integration of state-of-the-art LLM techniques into developer tools. Focus on designing new observability frameworks, mitigating hallucinations and bias, and scaling evaluation tooling for production workloads.

Location: Remote (United States). Optional offices in New York City and San Francisco Bay Area.

Salary: $185,000 - $200,000 per year

Company

Arize AI is a Series C AI observability and evaluation platform that empowers engineers to build, test, and monitor high-performing AI agents and applications.

What you will do

• Design, architect, and open-source new libraries, pipelines, and APIs to simplify LLM monitoring and evaluation.
• Partner with the AI open-source ecosystem, review pull requests, and steer project direction based on developer feedback.
• Prototype and iterate on state-of-the-art LLM techniques to create practical developer tooling.
• Integrate observability features to help teams diagnose and fix AI issues like hallucinations or bias.
• Evangelize tools through the creation of blog posts, white papers, tutorials, and documentation.

Requirements

• Must be based in the United States.
• Hands-on experience with LLM frameworks, prompt engineering techniques, and agent harnesses.
• Strong proficiency in TypeScript, including the ability to write isomorphic code for clients, servers, and edge runtimes.
• Proven track record of open-source contributions or active engagement in developer communities.

Nice to have

• Familiarity with ML observability, debugging AI applications, exploring embeddings, or building data-heavy dashboards.

Culture & Benefits

• Fully remote-first environment with a monthly WFH stipend for co-working spaces.
• Comprehensive health package including medical, dental, and vision insurance.
• Financial security via a 401(k) plan and a competitive equity package.
• Work-life balance support with unlimited paid time off and a generous parental leave plan.
• Opportunity to work with a talented team on large-scale production workloads analyzing millions of predictions daily.