Senior LLM Systems Engineer (Web3)

TL;DR

Senior LLM Systems Engineer (Web3): Building and optimizing LLM-driven components for an oracle automation stack with an accent on accuracy, resilience, and operational quality. Focus on developing evaluations, observability tooling, and agentic architectures to ensure dependable model behavior in production environments.

Location: 100% Remote (Global)

Salary: $100,000–$200,000 USD

Company

hirify.global is the core team behind UMA and Across, building infrastructure that pushes crypto forward.

What you will do

• Improve LLM accuracy through prompt engineering, model selection, tool usage, and structured outputs.
• Optimize system performance to reduce latency, token usage, and operational costs.
• Design resilience mechanisms including validation, retries, and human review paths for ambiguous inputs.
• Build comprehensive evaluation datasets, regression tests, and observability dashboards.
• Enhance agent orchestration and tool use across internal APIs, search workflows, and external data sources.
• Debug live production issues, investigate regressions, and improve operational runbooks.

Requirements

• 3+ years of professional software engineering experience in Python, TypeScript, or similar languages.
• Hands-on experience building production systems using LLMs, agents, retrieval, or model-powered workflows.
• Experience designing evaluations, test datasets, and quality metrics for AI systems.
• Strong debugging ability across APIs, databases, queues, logs, and model outputs.
• Practical understanding of prompt engineering, tool calling, and structured output validation.
• Ability to reason about correctness in uncertain or adversarial environments.

Nice to have

• Experience with oracle systems, prediction markets, DeFi protocols (e.g., UMA, Polymarket).
• Experience building agentic systems with browser automation or API tools.
• Familiarity with LLM tracing, model monitoring, and AI observability tools.
• Knowledge of blockchain operational constraints, RPC limits, and event logs.
• Experience with GCP, Cloud Run, GitHub Actions, and Terraform.

Culture & Benefits

• Competitive salary with meaningful long-term equity participation.
• Flexible payment options in stablecoins or fiat.
• 100% remote work environment with a focus on individual thrive-ability.
• Flexible time off including vacation and family care.
• Training and development opportunities.
• At least two team-wide offsites per year.