AI Product Engineer (AI)

Location: Remote-friendly role available in the United Kingdom, Canada, Germany, the Netherlands, or the United States

Salary: £90K–£135K annually

Company

ClickHouse is building ClickStack, an open-source observability platform that unifies logs, metrics, traces, and session replays.

What you will do

• Build AI agents that investigate incidents, surface anomalies, identify root causes, and summarize findings.
• Design reusable skills that encode debugging, ClickHouse query, and incident-response workflows.
• Own the agent stack, including context engineering, tool design, evaluations, tracing, and cost management.
• Build MCP servers, SDKs, and integrations that enable agents to read telemetry, take action, and remain observable.
• Collaborate with open-source contributors and customers while improving the product through real-world feedback.
• Address production challenges involving latency, cost, context-window limits, evaluation coverage, and hallucinations.

Requirements

• 5+ years of software engineering experience, including 1–2 years building LLM-powered systems or production agents.
• Strong backend skills in TypeScript/Node.js and/or Python, with comfort working in both.
• Hands-on experience with multi-step tool use, planning, memory, error recovery, and production agent failure modes.
• Experience designing skills, MCP servers, agent tools, authentication, scoping, and observability.
• Strong evaluation practice, including golden sets, LLM-as-judge, and regression detection.
• Proficiency with SQL and ClickHouse queries, plus Docker, Kubernetes, and active open-source or developer-community participation.

Nice to have

• Production agents in observability, incident response, or SRE.
• Agent observability experience involving tracing, cost attribution, evaluation pipelines, or OpenTelemetry.
• Experience with prompt caching, context compaction, columnar databases, or event-ingestion pipelines.
• Open-source AI or agent project contributions and familiarity with Go, Rust, or other systems languages.

Culture & Benefits

• Flexible, remote-friendly work environment across more than 25 countries.
• Employer healthcare contributions.
• Stock options for new team members.
• Flexible time off in the United States and generous leave entitlement in other countries.
• USD 500 home-office setup allowance for remote employees.
• Opportunities to attend company-wide in-person gatherings.