Data Engineer (AI)
ΠΡΡΡ & Π‘ΠΎΠΏΡΠΎΠ²ΠΎΠ΄
ΠΠ»Ρ ΠΌΡΡΡΠ° Ρ ΡΡΠΎΠΉ Π²Π°ΠΊΠ°Π½ΡΠΈΠ΅ΠΉ Π½ΡΠΆΠ΅Π½ Plus
ΠΠΏΠΈΡΠ°Π½ΠΈΠ΅ Π²Π°ΠΊΠ°Π½ΡΠΈΠΈ
Location: Fully remote across Argentina, Brazil, Colombia, Mexico, Chile, and Peru, aligned to the client's working day and United States time zones.
Company
is a San Francisco-based software development company that builds and operates production AI systems and provides nearshore AI engineering teams.
What you will do
- Build and operate batch and streaming ingestion and transformation pipelines using Spark, Kafka, dbt, and Airflow.
- Design warehouses and lakehouses on Snowflake, BigQuery, Redshift, or Databricks, including partitioning, file layout, performance, and cost controls.
- Develop chunking, embedding, indexing, and retrieval pipelines for RAG systems using pgvector, Pinecone, Qdrant, or Azure AI Search.
- Establish data quality contracts with tests, lineage, expectations, alerting, and reliable handling of schema evolution, backfills, and late-arriving data.
- Implement sensitive-data controls including PII classification, masking, access management, retention, deletion, and audit trails.
- Deploy and operate containerized data systems on Azure or AWS with CI/CD, orchestration, observability, and explicit runtime budgets while working in client environments.
Requirements
- 5+ years of experience building and operating production data pipelines with Python and SQL.
- Deep expertise in data warehouse or lakehouse design, dimensional modeling, incremental processing, and cost-performance trade-offs.
- Production-scale distributed processing with Spark, Kafka, Flink, or equivalent, plus orchestration with Airflow, Dagster, or Prefect.
- Experience with transformation under version control, testing, lineage, cloud deployment, Docker, CI/CD, and infrastructure as code.
- Active use of AI-assisted coding tools such as Claude Code, Cursor, or GitHub Copilot in production delivery.
- Clear written and spoken English at C1 level or above, with the ability to explain technical trade-offs directly to clients; a bachelor's degree or equivalent professional experience.
Nice to have
- Experience with vector and retrieval infrastructure, streaming or high-throughput workloads, and managed cloud data services.
- Experience with Jupyter, Google Colab, or similar notebooks.
- Delivery under SOC 2, HIPAA, or another compliance regime.
- Open-source contributions, technical writing, or active participation in the data engineering community.
Culture & Benefits
- AI-assisted coding tools are part of the standard engineering toolchain.
- Automated codebase audits evaluate security, cost, and architecture findings.
- Vendor-neutral work across OpenAI, Anthropic, and open-weight models, with access to 's Valkyrie production layer.
- Paid time off, U.S. holidays, AI training, mentored career development, and profit sharing.
- USD remuneration and opportunities for open-source work, community teaching, and philanthropy.
ΠΡΠ΄ΡΡΠ΅ ΠΎΡΡΠΎΡΠΎΠΆΠ½Ρ
ΠΡΠ»ΠΈ ΡΠ°Π±ΠΎΡΠΎΠ΄Π°ΡΠ΅Π»Ρ ΠΏΡΠΎΡΠΈΡ Π²ΠΎΠΉΡΠΈ Π² ΠΈΡ ΡΠΈΡΡΠ΅ΠΌΡ, ΠΈΡΠΏΠΎΠ»ΡΠ·ΡΡ iCloud/Google, ΠΏΡΠΈΡΠ»Π°ΡΡ ΠΊΠΎΠ΄/ΠΏΠ°ΡΠΎΠ»Ρ, Π·Π°ΠΏΡΡΡΠΈΡΡ ΠΊΠΎΠ΄/ΠΠ, Π½Π΅ Π΄Π΅Π»Π°ΠΉΡΠ΅ ΡΡΠΎΠ³ΠΎ. ΠΡΠΎ ΠΌΠΎΡΠ΅Π½Π½ΠΈΠΊΠΈ. ΠΠ±ΡΠ·Π°ΡΠ΅Π»ΡΠ½ΠΎ ΠΆΠΌΠΈΡΠ΅ Β«ΠΠΎΠΆΠ°Π»ΠΎΠ²Π°ΡΡΡΡΒ» ΠΈΠ»ΠΈ ΠΏΠΈΡΠΈΡΠ΅ Π² ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠΊΡ. ΠΠΎΠ΄ΡΠΎΠ±Π½Π΅Π΅ Π² Π³Π°ΠΉΠ΄Π΅ β