Senior AI Ops Engineer (AI)

TL;DR

Senior AI Ops Engineer (AI): Operate, maintain, and evolve AI systems including LLM-based services and agentic workflows deployed on AWS with an accent on reliability, scalability, observability, and security. Focus on architecting prompts, curating knowledge contexts, optimizing workflows, evaluating models, and implementing governance in a regulated fintech environment.

Hybrid in Madrid or Barcelona

Company

Fintech company enabling global brands to collect payments in 40 emerging markets as a payments processor and merchant of record.

What you will do

• Operate and maintain AI systems for reliability, scalability, and observability on AWS, including LLM-based systems and agentic workflows.
• Architect agent behavior with system prompts, personas, guardrails, and tool definitions.
• Curate knowledge context for agents and RAG systems, optimizing data chunking and metadata.
• Design and optimize AI workflows, prompt libraries, skills repositories, and automation pipelines.
• Evaluate and benchmark AI models across quality, latency, cost, safety, and robustness.
• Implement automated evaluations with ground truth datasets and LLM-as-a-Judge pipelines.
• Drive experimentation cycles and implement governance, versioning, and access controls.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
• 5+ years in ML Engineering, Data Science, AI Engineering, or Platform Engineering with production AI/ML systems.
• Expertise in LLMs, RAG, embeddings, prompt engineering, evaluation frameworks, and inference trade-offs.
• Experience with CI/CD for AI, model versioning, experiment tracking, monitoring, and incident response.
• Strong analytical skills for evaluating AI systems, vendors, and architectures.
• Familiarity with AI observability platforms like LangSmith, Arize, or HoneyHive.
• Builder mentality for customizing AI systems, integrations, and no-code/low-code tools.
• Understanding of security, data privacy, and compliance in regulated environments.

Culture & Benefits

• Flexible schedules focused on impact and productivity.
• Hybrid work combining self-managed time with in-person collaboration in hubs.
• Referral bonuses, social budget for team activities, and hirify.global Houses for global coworking weeks.
• Dynamic fintech environment with opportunities for creativity and international career growth.
• Global team of 1000+ from 30+ nationalities.