Senior AI Engineer (Observability)

#vacancy

AI Engineer — Observability (Senior)

Start: ~13.04.2026 | ⏳ Duration: 6 months
Rate: $3000–3400 gross/month
Remote | Customer: USA | 🌍 Open worldwide EXCEPT Russian Federation

Core Focus:
• LLM-powered pipelines: instrumentation, evaluation, monitoring
• LLMOps & observability: Langfuse, Arize, W&B, LangSmith, OpenLLMetry
• RAG, prompt engineering, vector search (Azure AI Search, Pinecone, Qdrant)
• LLM evaluation design: datasets, scoring, LLM-as-a-judge
• Python & C#/.NET | Cloud observability: OpenTelemetry, Azure Monitor
• CI/CD: Azure DevOps | LLM cost management & content safety/PII

Requirements:
• Bachelor's in CS/Engineering/IT + 5+ years delivering production systems
• Experience with AI features in production + strong observability fundamentals
• Work in regulated environments (SOC 2, ISO 27001) — a plus
• Strong communication skills | QA/ML/Data Eng background is a plus

📋 Responsibilities:
🔸 Build & monitor LLM-powered pipelines in production
🔸 Design evaluation frameworks (datasets, scoring, semantic metrics)
🔸 Implement guardrail monitoring, content safety & PII protection
🔸 Optimize LLM costs & run A/B tests for prompt/model performance
🔸 Collaborate with distributed teams across time zones

📩 If you match the criteria, send your CV + current location + salary expectations (gross USD) to: Показать контакты

#AIEngineer #LLMOps #Observability #Python #DotNet #RAG #RemoteJobs #Hiring