Senior AI Developer (AI)

Location: United States; Remote

Salary: $200K–$250K

Company

ClickUp is building an AI-native workspace that unifies tasks, documents, chat, calendar, and enterprise search with context-driven AI.

What you will do

• Design, build, and own AI evaluation systems with golden datasets, LLM-as-judge scoring, regression detection, and quality tracking.
• Build the core agent harness and self-improvement loops that modify agents or prompts, rerun evaluations, and iterate automatically.
• Benchmark and manage multiple models, including model selection, routing, fallback strategies, and quality, latency, and cost trade-offs.
• Architect scalable AI platform services for model deployment, orchestration, lifecycle management, serving, monitoring, logging, and automated evaluation.
• Build backend APIs that integrate AI features into the core platform and collaborate with product, frontend, and data teams.
• Drive AI privacy, security, anonymization, secure data handling, compliance, reliability, and production performance practices.

Requirements

• 5+ years of software engineering experience, including 2+ years building production LLM or ML systems.
• Production experience building LLM evaluation systems, including golden datasets, LLM-as-judge, judge calibration, offline and online evaluations, and product-quality measurement.
• Strong experiment design and statistical rigor, including A/B testing, offline versus online metrics, and distinguishing regressions from noisy or variable results.
• Experience applying LLMs and AI models to real-world, customer-facing product features.
• Experience integrating and managing multiple LLMs, including benchmarking, routing, and cost, latency, and quality trade-offs.
• Deep expertise in backend engineering, distributed systems, and cloud-native technologies such as Kubernetes, Docker, AWS, GCP, or Azure.
• Strong programming skills in Python, Go, TypeScript, or similar backend and AI platform languages.
• Proficiency with orchestration frameworks and workflow engines such as LangGraph, Airflow, Ray, or similar tools.
• Familiarity with search and retrieval technologies and their integration into AI applications, plus strong collaboration and communication skills.

Nice to have

• Background in data science, applied science, or machine learning engineering.
• Experience with evaluation tooling such as Braintrust, LangSmith, Weave, Arize, or in-house frameworks.
• Experience with model routing, AI gateways, or inference optimization.

Culture & Benefits

• AI fluency is evaluated during hiring, and every team member is expected to use AI daily.
• Work remotely in a full-time employment role.
• Collaborate cross-functionally with product, frontend, data, and engineering teams.
• ClickUp is an Equal Opportunity Employer and processes candidate data under applicable privacy laws.
• Engineering and product roles may receive employment visa sponsorship based on the specific role's business needs; sponsorship is not guaranteed.

Hiring process

• Applications may be reviewed with artificial intelligence and machine learning tools against role-related criteria; these tools support but do not replace human decision-making.
• Recruitment contact is initiated only through an @clickup.com email address or the official ClickUp careers portal.