Principal Software Engineer (GenAI)

TL;DR

Principal Software Engineer (GenAI): Driving the technical vision and execution of advanced AI-powered solutions for the insurance industry with an accent on LLMs, RAG, and AI orchestration runtimes. Focus on designing scalable AI services, implementing multi-agent systems, and building platform-level capabilities for observability and governance.

Location: Must be based in or within a reasonable distance of Boston, MA, Columbia, SC, Bay Area, CA, or Bolivar, MO to participate in in-person collaboration.

Salary: $136,100 – $219,600

Company

Intelligent solutions provider defining the future of the property and casualty (P&C) and general insurance industry via modern SaaS platforms.

What you will do

• Lead technical strategy for GenAI-based products and platforms, ensuring alignment with enterprise architecture.
• Design and implement the AI orchestration runtime, including agent workflows, context assembly, and tool invocation.
• Build platform-level capabilities for observability, evaluation, auditability, and cost management across AI workloads.
• Develop core AI services, including model orchestration, inference pipelines, and standardized prompt patterns.
• Mentor and guide engineers on modern AI development, distributed systems, and performance optimization.
• Champion CI/CD and MLOps practices for continuous delivery of AI features and models.

Requirements

• 7+ years of software development experience and 5+ years of strategic leadership experience.
• Expertise in AI/ML systems: LLM integration, RAG pipelines, vector databases, and prompting strategies.
• Hands-on experience with agent frameworks and workflow orchestration (e.g., LangGraph).
• Proficiency in cloud-native microservice development using Java, .NET, Python, or TypeScript.
• Experience with LLM evaluation frameworks such as RAGAS or LangSmith.
• Legally authorized to work in the USA; the company does not sponsor visa petitions.

Nice to have

• Experience in regulated industries such as financial services, insurance, or healthcare.
• Knowledge of CQRS, event-driven architecture, and Kafka.
• Experience with Terraform, Ansible, or other IaC platforms.

Culture & Benefits

• Flexible-First work environment with options for office, home, or hybrid schedules.
• Comprehensive health coverage including medical, dental, vision, life, and disability insurance.
• 401(k) Retirement Plan, Flexible Spending Account (FSA), and Health Savings Account (HSA).
• Paid holidays, vacation, and volunteer time.
• Inclusive, collaborative culture based on core values of respect and transparency.