Senior Software Engineer (AI Infrastructure)

Location: Hybrid in Redwood City, California, or San Francisco, California

Salary: $220,000–$260,000 USD annually

Company

Snorkel AI helps enterprises transform expert knowledge and proprietary data into specialized, production-ready AI systems.

What you will do

• Design and build the shared agentic platform, including orchestration, memory, context graphs, MCP tool access, evaluation, observability, and governance layers.
• Develop LLM efficiency infrastructure for queuing, throttling, batching, caching, model routing, token metering, and cost attribution.
• Build data access libraries and SDKs for Snowflake, S3, and RDS with authentication, RBAC, pagination, and query governance.
• Implement reliable event-driven data flows with event brokers, CDC connectors, schema registries, routing, and dead-letter queues.
• Build data and agent governance, lineage, audit, PII handling, and retention infrastructure for enterprise and federal compliance.
• Own reliability and cost optimization through OpenTelemetry instrumentation, SLOs, alerting, incident response, and on-call support.

Requirements

• 4+ years of experience building and operating platform infrastructure, data infrastructure, or backend systems with significant data components.
• Strong Python proficiency and hands-on experience with LLM APIs, tokens, context windows, rate limits, batching, and caching.
• Daily use of AI-assisted development tools such as Claude Code, Cursor, or similar is required.
• Strong SQL skills and experience with at least two of Snowflake, Redshift, and Postgres.
• Experience with AWS services including S3, RDS, EKS, EventBridge, and IAM, plus Terraform-managed environments.
• Experience with Kubernetes, data orchestration or transformation tools, and data governance concepts such as RBAC, PII handling, audit logging, and lineage.

Nice to have

• Experience with agentic systems, MCP gateways, agent memory or knowledge layers, or evaluation harnesses.
• Experience with LLM serving infrastructure, event-driven architectures, shared SDKs, OpenTelemetry, ClickHouse, Ray, or regulated environments.

Culture & Benefits

• Work in a rapidly scaling company with market-proven solutions and robust funding.
• Influence foundational technical priorities and strategic decisions.
• Opportunities for technical growth, leadership development, and cross-functional learning.
• Equal employment opportunity and reasonable accommodation are provided.