3 дня назад
Data Engineer (AI)
hhВакансия с HeadHunter. Контакт ведёт на hh.ru
Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Описание вакансии
Текст:
TL;DR
Data Engineer (AI) (Python/Spark/SQL): Building and optimizing fault-tolerant ETL/ELT pipelines, analytics-ready data models, and data quality frameworks for a ticketing platform with an accent on medallion architecture, Spark performance, and scalable data delivery. Focus on designing dimensional models, diagnosing multi-system failures across Spark, Kafka, and dbt, and structuring pipelines for AI-assisted development.
Location: Armenia; 100% remote
Company
Software development company delivering projects for customers in the US and Europe with a distributed team across Eastern Europe, the Americas, Armenia, Georgia, and Kazakhstan.
What you will do
- Lead discovery and requirements-gathering sessions with business stakeholders.
- Document source schemas and define analytics-ready data model specifications.
- Build, optimize, and maintain end-to-end ETL/ELT pipelines using dbt macros, incremental models, and snapshots.
- Design medallion architecture layers, foundational tables, star schemas, and reporting marts with SLAs and data quality contracts.
- Optimize Spark jobs and diagnose pipeline issues involving Spark, Kafka, and dbt.
- Create technical documentation, data model diagrams, and operational runbooks for production support.
Requirements
- 5+ years of data engineering experience.
- Advanced proficiency in Python, Spark, and SQL.
- Strong experience with AWS and Databricks.
- Familiarity with Kafka and modern data stack tools such as dbt and Airflow or equivalent.
- Deep understanding of dimensional modeling, medallion architecture, and data warehouse design principles.
- Strong spoken English at Intermediate level or higher.
Nice to have
- Knowledge of lambda, kappa, and lakehouse system topologies.
- Ability to structure problems for AI assistance and design pipelines for AI-assisted development.
Culture & Benefits
- 100% remote work from Armenia.
- Full-time schedule of 8 hours per day.
- Long-term project with a US-based customer.
- USD compensation.
- Paid vacation and holidays.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →