Senior AI Operations Engineer (AI)

Location: Hybrid role based in the Menlo Park, CA; New York, NY; or Bellevue, WA offices, with in-person attendance expected at least 3 days per week.

Salary: $153,000–$180,000 USD base pay for Zone 1 locations; other compensation zones range from $119,000–$158,000 USD. The role is also eligible for bonuses, equity, and benefits.

Company

Robinhood is a fintech company building enterprise AI infrastructure to make AI capabilities reliable, secure, and accessible across the organization.

What you will do

• Build internal tooling, automation, and self-service solutions for AI operations and developer productivity.
• Troubleshoot and resolve complex issues involving AI platforms, LLM integrations, model behavior, APIs, and system performance.
• Manage Anthropic Claude and Google Gemini integrations, optimizing performance, token utilization, reliability, and cost.
• Develop observability, monitoring, and deployment pipelines for AI workloads, including inference latency, API costs, token usage, and error rates.
• Support agentic workflows, orchestration layers, vector databases, and retrieval-augmented generation systems.
• Partner with Product, Software Engineering, Business Systems, and AI Strategy teams to drive long-term improvements.

Requirements

• 5+ years of experience in IT Operations, Site Reliability Engineering, or AI infrastructure and support, including operation of complex production systems.
• Hands-on experience with enterprise AI platforms and LLM integrations, particularly Anthropic Claude and Google Gemini, including APIs, prompt operations, and token management.
• Strong Linux administration skills and scripting or automation experience with Python, Bash, or similar languages.
• Experience with infrastructure provisioning, configuration management, and orchestration tools such as Terraform, Ansible, Chef, or Kubernetes.
• Strong understanding of production infrastructure, reliability, monitoring, and troubleshooting across cloud or on-premises environments.
• Ability to investigate ambiguous technical problems independently, identify root causes, and develop scalable preventive solutions.
• Strong communication and collaboration skills, including direct partnership with developers and cross-functional teams.

Nice to have

• Experience with GPU clusters, Slurm, Ray, Pinecone, Milvus, LangChain, LlamaIndex, hybrid cloud, or bare-metal infrastructure.

Culture & Benefits

• High-impact work in a fast-moving environment with ethics at the center of decision-making.
• Performance-driven compensation with bonus programs, equity ownership, and 401(k) matching.
• Health insurance, life and disability insurance, fertility and mental health benefits, paid time off, sick time, parental leave, and company holidays.
• Access to AI tools, continuous AI skill-building, a lifestyle wallet, and an employee investment fund for eligible US employees.
• In-person office experience with catered meals, events, and comfortable workspaces.