AI Engineer (Gen AI)

TL;DR

AI Engineer (Gen AI): Designing, implementing, and evaluating LLM applications and agents with an accent on turning frontier research into teachable workflows and production-grade reference implementations. Focus on rapid prototyping, careful evaluation, and building agentic systems with clear trade-offs and responsible deployment.

Location: Remote (US only). Office locations available in Livingston, NJ, New York, NY, San Francisco, CA, Sunnyvale, CA, and Bellevue, WA. Remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. Requires US work authorization and applicants must be a U.S. person as defined by export control regulations.

Salary: $188,000–$275,000 (USD)

Company

Weights & Biases, acquired by CoreWeave, provides a powerful end-to-end platform to develop, deploy, and iterate AI faster for over 1,500 organizations including OpenAI and Meta.

What you will do

• Ship end-to-end GenAI workflows (prompting → RAG → tools/agents → eval → serve) with reproducible artifacts.
• Build agentic systems with MCP servers/clients and secure tool/resource integrations.
• Design evaluation harnesses (RAG/agent evals, golden sets, regression tests) and drive continuous improvement.
• Publish engineering artifacts (code, docs, talks, tutorials) and engage with OSS and customer engineers.
• Partner with product/solutions to launch LLM-powered features with clear targets and safety checks.
• Run growth experiments to track usage of Weights & Biases products.

Requirements

• Software engineering: 6+ years building production systems; strong Python or TypeScript, system design, testing, CI/CD, observability.
• GenAI apps: Shipped LLM-powered features (tools/agents/function calling) with measurable impact.
• Agentic patterns: Implemented planners/executors, tool orchestration, sandboxing, and failure taxonomies.
• RAG: Pragmatic mastery of chunking, embeddings, vector/hybrid search, and retrieval policy design.
• Evaluation: Designed LLM/RAG/agent evals (offline golden sets, counterfactuals, user studies, guardrail tests); stats literacy.
• Serving & productization: Comfortable with queueing, caching, streaming, and cost controls; can debug latency at various layers.
• Public signal: 2+ substantial OSS repos/blog posts/talks/videos with adoption and reproducible artifacts.
• Must be a U.S. person (U.S. citizen/national, lawful permanent resident, refugee, or asylee) or eligible to access export controlled information per U.S. Government regulations.

Nice to have

• Experience building with AI SDKs / agent frameworks and shipping developer-facing examples.
• Production agent security/sandboxing, red-teaming, and policy/PII enforcement.
• Operated eval platforms or built judge models/heuristics; experience leading metrics reviews.
• Customer-facing enablement: templates or reference implementations adopted by external teams.

Culture & Benefits

• Competitive salary, discretionary bonus, equity awards, and comprehensive benefits.
• 100% company-paid medical, dental, and vision insurance.
• Flexible Spending Account (FSA) and Health Savings Account (HSA).
• 401(k) with a generous employer match and Employee Stock Purchase Program (ESPP).
• Flexible PTO, paid parental leave, and mental wellness benefits.
• Catered lunch each day in office and data center locations.