Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Data Engineer (Python/SQL): Building and scaling critical data pipelines for an AI-native equipment aftermarket platform with an accent on robust architecture, data quality, and modern data stack implementation. Focus on designing idempotent pipelines, implementing medallion architecture, and mentoring mid-level engineers to drive the overarching data strategy.
Location: Remote (Latin America)
Company
is a leading nearshore staff augmentation provider headquartered in New York, connecting highly skilled Latin American tech professionals with U.S. companies.
What you will do
- Design and build robust, idempotent data pipelines from scratch utilizing a modern data stack.
- Develop star and snowflake schemas and write precise, grain-aware SQL for scalable data marts.
- Write production-grade, unit-tested Python code following strict engineering disciplines (type hinting, testing).
- Build dbt models across staging, intermediate, and mart layers and deploy jobs using Databricks Asset Bundles (DAB).
- Implement rigorous data quality checks and maintain governance through dbt tests and documentation.
- Own pipelines end-to-end, define technical direction, and mentor mid-level engineers through code reviews.
Requirements
- Must be based in Latin America.
- Expertise in SQL and dimensional modeling (medallion architecture, SCDs, grain management).
- Extensive experience with production Python engineering, including pytest and ruff.
- Strong ability to diagnose and resolve PySpark jobs using Spark UI.
- Deep understanding of Delta Lake (MERGE, OPTIMIZE, Z-ORDER) and dbt (models, tests, exposures).
- Experience with Unity Catalog, Databricks Asset Bundles, and disciplined Git workflows.
Nice to have
- Experience with Azure Data Factory (ADF) and Azure Data Lake storage.
- Familiarity with dbt observability tools like Elementary.
- Proficiency in GitHub Actions workflows for Databricks deployment.
- Experience with AI-assisted development tools such as Claude Code.
- Awareness of PII detection and masking best practices.
Culture & Benefits
- 100% remote work with a focus on results and autonomy.
- Highly competitive market-leading compensation paid in USD.
- Paid time off policies to ensure work-life balance.
- Opportunity to collaborate with senior talent and top American companies.
- Access to a diverse, global network of over 600 professionals.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →