Software Engineer - Core Services (AI)

TL;DR

Software Engineer - Core Services (AI): Building and scaling the foundational data platform that powers AI development with an accent on event-driven architectures and high-performance data access layers. Focus on designing scalable SDKs, implementing robust data governance, and optimizing cloud infrastructure for enterprise-grade AI systems.

Location: Hybrid (Redwood City, CA or San Francisco, CA)

Salary: $172,000 - $215,000 USD

Company

A data-centric AI company helping enterprises transform expert knowledge into specialized AI at scale.

What you will do

• Develop shared data access libraries and SDKs for Snowflake, S3, and RDS to abstract source-level complexity.
• Implement event-driven data flows using event brokers, CDC connectors, and schema registries.
• Build systems for data lineage, RBAC governance, and audit logging for enterprise and federal compliance.
• Instrument the platform with OpenTelemetry and monitor SLOs for query latency and pipeline success.
• Optimize infrastructure costs through query estimation and workload right-sizing.

Requirements

• 4+ years of experience building platform, data infrastructure, or backend systems.
• Strong proficiency in Python and SQL (experience with Snowflake, Redshift, or Postgres).
• Experience with AWS (S3, RDS, EKS, EventBridge, IAM) and Terraform.
• Hands-on experience with Kubernetes (EKS) for deploying and scaling services.
• Experience with data orchestration tools (Prefect, Airflow, or Dagster) and dbt.
• Fluency with AI-assisted development tools (Claude Code, Cursor, etc.) is a hard requirement.

Nice to have

• Experience building shared libraries or SDKs with versioning and backward compatibility.
• Deep knowledge of event-driven architectures, CDC, and at-least-once delivery semantics.
• Experience with OpenTelemetry, ClickHouse, or Ray for distributed compute.
• Prior work in regulated environments such as SOC 2, FedRAMP, or HIPAA.

Culture & Benefits

• Opportunity to join a rapidly scaling company with robust funding and market-proven solutions.
• High level of ownership and influence over strategic technical decisions.
• Environment designed for growth, learning, and leadership exploration.
• Commitment to diversity and equal employment opportunities.