4 дня назад
Data Engineer (Spark/AWS)
hhВакансия с HeadHunter. Контакт ведёт на hh.ru
Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Описание вакансии
Текст:
TL;DR
Data Engineer (Spark/AWS): Building and optimizing end-to-end data pipelines, analytics-ready models, and data quality frameworks for an event-ticketing platform with an accent on Spark performance, medallion architecture, and scalable ETL/ELT delivery. Focus on designing fault-tolerant pipelines, diagnosing multi-system failures across Spark, Kafka, and dbt, and implementing AI-assisted data engineering practices.
Location: Remote from Montenegro
Salary: Attractive USD compensation
Company
Nitka Technologies develops software for customers in the US and Europe and brings together approximately 300 professionals across Eastern Europe, North and South America, Armenia, Georgia, and Kazakhstan.
What you will do
- Lead discovery and requirements-gathering sessions with business stakeholders, document source schemas, and define analytics-ready data models.
- Build, optimize, and maintain end-to-end ETL/ELT pipelines using reusable dbt macros, incremental models, and snapshot patterns.
- Design medallion architecture layers, foundational tables, star schemas, reporting marts, SLAs, and data quality contracts.
- Tune Spark jobs by optimizing partitions, reducing shuffle, and improving transformation efficiency.
- Implement automated data quality checks and diagnose complex issues across Spark, Kafka, dbt, and other systems.
- Create technical documentation, data model diagrams, and operational runbooks for production support.
Requirements
- 5+ years of data engineering experience.
- Advanced proficiency in Python, Spark, and SQL.
- Strong experience with AWS and Databricks.
- Experience with Kafka and modern data stack tools such as dbt and Airflow or equivalent.
- Deep understanding of dimensional modeling, medallion architecture, and data warehouse design principles.
- Strong spoken English at Intermediate level or higher.
Nice to have
- Knowledge of lambda, kappa, and lakehouse system topologies.
- AI fluency, including structuring problems for AI assistance and designing pipelines for AI-assisted development.
Culture & Benefits
- 100% remote work from Montenegro.
- Full-time schedule of 8 hours per day.
- Long-term project with a customer in California that leads the event-ticketing industry in Europe and the USA.
- Paid vacation and holidays.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →