Software Engineer III (AI)

TL;DR

Software Engineer III (AI): Designing, building, and operating production LLM systems for enterprise use with an accent on RAG services, eval/guardrail pipelines, and API integrations. Focus on building end-to-end RAG pipelines, implementing LLM evaluation and guardrails, and standing up LLMOps/MLOps practices.

Location: Onsite in Bangalore, India

Company

hirify.global is a leading technology platform for accelerating life and annuities growth, simplifying the experience of buying, selling, and administering insurance products.

What you will do

• Own backend services for GenAI features, from design to production.
• Build end-to-end RAG pipelines, including chunking, embeddings, and retrieval.
• Extend MCP integrations for major internal applications and APIs.
• Implement LLM evaluation and guardrails, such as prompt/unit evals and A/B tests.
• Stand up LLMOps/MLOps practices, including CI/CD for models and prompts, and cost controls.
• Create SDKs/REST/GraphQL integrations, handling authentication and rate limits.

Requirements

• Total 5-9 years of experience is required.
• Strong backend skills in Python (FastAPI, Pydantic, async) or TypeScript/Node (Express/Fastify/Next API routes).
• Hands-on experience with GenAI, including LLM prompting and at least one RAG system in production or a rigorous POC.
• Proficiency in vector search technologies like FAISS, pgvector, Pinecone, or Weaviate.
• Practical MLOps/LLMOps/AIOps experience, including model/prompt versioning and monitoring.
• Familiarity with cloud and infrastructure, including Docker, Kubernetes, and a major cloud provider (AWS/Azure/GCP).

Nice to have

• Experience with LangChain/LlamaIndex/LangGraph, Agentic AI, and major LLM SDKs (OpenAI/Azure, Gemini).
• Knowledge of retrieval enhancements such as hybrid search and re-rankers.
• Experience with data systems like PostgreSQL, Redis, Kafka/SQS.
• Familiarity with observability tools such as OpenTelemetry, Prometheus, and Grafana.
• Basic frontend skills (React/Next.js) for internal tools.

Culture & Benefits

• Collaborate with smart, creative professionals dedicated to delivering cutting-edge technologies.
• Contribute to deeper data insights and enhanced services in the insurance sector.
• Work within a company committed to core values: be bold, team up, deliver value.
• Be part of a diverse workforce, as an Equal Opportunity employer.