Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Data Engineer (AI): Building and maintaining robust data pipelines and infrastructure for ML applications with an accent on data quality, lifecycle management, and AI-ready dataset delivery. Focus on designing scalable ETL/ELT processes, orchestrating complex workflows, and bridging the gap between raw industrial data and model training requirements.
Location: Remote (Brazil)
Company
is an industrial technology company that combines hardware and software to provide predictive maintenance solutions for frontline workers.
What you will do
- Design and maintain robust data pipelines for diverse sources including APIs, documents, and raw sensor data.
- Integrate and optimize ETL/ELT processes to improve performance and maintainability.
- Manage the full dataset lifecycle from raw ingestion to training-ready delivery.
- Build and maintain labeling pipeline infrastructure for ML applications.
- Define and enforce data quality standards and governance practices.
- Participate in architectural decisions and technical mentorship within the team.
Requirements
- 3+ years of experience in data engineering.
- Proficiency in Python for data manipulation and automation.
- Strong SQL skills for data modeling and query optimization.
- Experience with workflow orchestration tools like Airflow, Temporal, or Dagster.
- Experience with distributed data processing using Spark or Databricks.
- Familiarity with streaming systems and event-driven pipelines like Kafka or Kinesis.
Nice to have
- Experience with Go for high-performance components.
- Knowledge of dbt and open table formats like Delta Lake or Iceberg.
- Cloud experience, specifically OCI, AWS, GCP, or Azure.
- Experience with data annotation workflows or GenAI tooling.
Culture & Benefits
- Competitive salary and stock options.
- 30 days of paid annual leave.
- Education and courses stipend.
- Unique travel benefit: a trip anywhere in the world every 4 years.
- Comprehensive health and dental insurance.
- Wellhub and sports incentive program.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →