Open Source AI Engineer (AI)

TL;DR

Open Source AI Engineer (AI): Designing and open-sourcing LLM observability frameworks and tooling to help developers build, test, and improve AI agents with an accent on framework architecture and community-driven development. Focus on creating libraries and APIs to diagnose LLM hallucinations and bias.

Location: Fully remote, with optional offices in New York City and the San Francisco Bay Area

Salary: $185,000 - $200,000

Company

Arize AI is a leading AI & Agent Engineering observability and evaluation platform empowering teams to ship reliable and high-performing AI applications.

What you will do

• Design and architect open-source libraries, pipelines, and APIs to monitor and evaluate LLM output.
• Collaborate with the broader AI open source ecosystem by reviewing pull requests and steering project direction.
• Prototype state-of-the-art LLM techniques and turn research into practical developer tooling.
• Integrate observability tools to help teams diagnose and fix issues like hallucinations or bias.
• Educate the community through blog posts, white papers, and tutorials.

Requirements

• Hands-on experience with LLM frameworks, prompt engineering, and agent harnesses.
• Strong proficiency in TypeScript for writing isomorphic code across clients, servers, and edge runtimes.
• Proven track record of open source contributions or active engagement in developer communities.
• Eligibility for US-based benefits (401k, US health insurance).

Nice to have

• Familiarity with ML observability, exploring embeddings, or building data-heavy dashboards.

Culture & Benefits

• Remote-first environment with WFH monthly stipends for co-working spaces.
• Comprehensive healthcare package including medical, dental, and vision.
• Financial security through a 401(k) plan and competitive equity package.
• Unlimited paid time off and generous parental leave.
• Inclusive culture with dedicated subgroups (e.g., Lady Arizers) and focus on responsible AI.