Senior AI Context Engineer (RAG)

TL;DR

Senior AI Context Engineer (RAG): Building and optimizing high-quality data retrieval pipelines for enterprise AI applications with an accent on document chunking, vector indexing, and semantic search precision. Focus on ensuring secure, compliant, and high-performance context delivery for LLMs within a complex healthcare data environment.

Location: Remote (USA only, excluding specific states: AK, HI, CA, WA, OR, CO, WY, MT, NY, CT, VT, PA, ME)

Salary: $124,666 – $175,734 USD

Company

A nonprofit member association providing health and dental benefits to millions of federal employees and retirees since 1937.

What you will do

• Develop and refine advanced parsing and chunking workflows for structured and unstructured enterprise data.
• Implement hybrid search, metadata routing, and reranking logic to improve retrieval precision and reduce hallucinations.
• Design and manage vector indexing strategies and embedding schemes for high-performance retrieval.
• Establish automated evaluation frameworks to monitor retrieval relevance, groundedness, and embedding drift.
• Ensure all data processing adheres to HIPAA and HITRUST standards, including PHI masking and RBAC implementation.
• Collaborate with AI architects and full-stack developers to supply high-accuracy context layers for GenAI features.

Requirements

• 5+ years of experience in backend software engineering, applied ML, or data-centric development.
• 1–2 years of hands-on experience specifically optimizing AI and RAG architectures and vector retrieval pipelines.
• Advanced proficiency in Python and SQL.
• Deep experience with parsing frameworks like LlamaIndex, Unstructured.io, or LangChain.
• Proven experience with vector databases such as Pinecone, pgvector, Weaviate, or Azure AI Search.
• Must be based in the US (excluding specific restricted states) and provide a dedicated, high-speed home office setup.

Culture & Benefits

• Comprehensive health, dental, and vision benefits effective from day one.
• 401(k) retirement plan with company match and annual contribution.
• Robust employee well-being program and paid time off.
• Tuition assistance program for professional development.
• Company-provided life, AD&D, and disability insurance.