17 часов назад
Data Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AI): Building scalable batch and real-time data pipelines, warehouses, lakes, and integrations for an AI-driven e-commerce platform with an accent on ETL/ELT workflows, data quality, and large-scale processing. Focus on optimizing distributed data systems, preparing datasets for machine learning, and designing reliable data infrastructure.
Location: Remote
Company
.ai develops AI, ML, and real-time decision capabilities for e-commerce and business insights.
What you will do
- Design, build, and maintain scalable batch and real-time data pipelines.
- Develop ETL/ELT workflows that collect, transform, and load data from multiple sources.
- Build and maintain data models, warehouses, lakes, and integrations with APIs, databases, cloud platforms, and third-party systems.
- Ensure data quality, validation, monitoring, testing, security, governance, and access control.
- Optimize data processing for performance, scalability, and cost efficiency while troubleshooting pipeline and infrastructure issues.
- Collaborate with Data Science, ML Engineering, Product, and Engineering teams and contribute to the evolution of the data platform architecture.
Requirements
- 5–7 years of experience in Data Engineering or a similar role.
- Strong programming skills in Python or another programming language, with strong SQL and relational database experience.
- Hands-on experience building ETL/ELT pipelines and data workflows.
- Experience with Spark/PySpark, distributed systems, and large-scale datasets.
- Experience with AWS, Azure, or GCP and workflow orchestration tools such as Airflow or Dagster.
- Knowledge of data warehousing, data lakes, data modeling, database design, performance optimization, Git, CI/CD, and software engineering best practices.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →