Software Engineer, AI Platform (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Software Engineer, AI Platform (AI/Python): Building and owning the data platform, ETL pipelines, and agent infrastructure for production AI reliability with an accent on LLM-driven data transformation and structured output. Focus on optimizing throughput, cost, and observability of AI jobs while maintaining high iteration speed in an early-stage environment.
Location: On-site in San Francisco, CA (5 days a week)
Salary: $180,000 – $250,000 + Equity
Company
builds a platform that captures and analyzes observable work data inside large organizations to measure productivity and identify AI automation opportunities.
What you will do
- Own and evolve the core data platform powering every job across the company.
- Design and run LLM ETL pipelines for data ingestion, transformation, enrichment, and storage.
- Build agent transformation infrastructure to convert agent outputs into structured, queryable downstream data.
- Optimize reliability, throughput, and costs of production LLM-driven jobs.
- Develop observability tooling to enable the team to debug and iterate rapidly.
- Collaborate with AI Engineers to shape platform interfaces and expose new capabilities.
Requirements
- Strong Python engineering experience supporting production systems (e.g., FastAPI).
- Proven experience building production pipelines handling non-trivial volume, retries, and failure recovery.
- Hands-on experience with data orchestrators (Dagster, Airflow, Prefect, or Temporal) and dbt.
- Proficiency with PostgreSQL at scale, including schema design and migrations.
- Experience with AWS infrastructure (ECS, Lambda, SQS, Step Functions, RDS, S3) and IaC (Terraform/Terragrunt).
- Familiarity with LLM APIs and their operational constraints (latency, cost, failure modes).
Nice to have
- Experience with distributed compute for Python (Anyscale Ray, Dask, or Spark).
- Proficiency with Polars and Pandas for data processing.
- Experience with Datadog for observability and metrics.
- Familiarity with pgvector or other vector stores.
- Multi-region AWS deployment experience and some TypeScript/Node.js knowledge.
Culture & Benefits
- Competitive base salary and ESOP equity.
- $1,000 per month food and commuting allowance.
- Laptop of choice.
- E-3 sponsorship and relocation stipend available for Australians.
- Fast-paced, early-stage startup environment emphasizing rapid iteration.
Hiring process
- Resume screen.
- 1:1 interview with the founder.
- Technical deep-dive on past data platform or backend engineering work.
- Collaborative problem-solving session with the team.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →