3 дня назад
Data Engineer (Spark)
hhВакансия с HeadHunter. Контакт ведёт на hh.ru
Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Описание вакансии
Текст:
TL;DR
Data Engineer (Spark) (AWS/Databricks): Building and optimizing end-to-end data pipelines, analytical data models, and data quality frameworks for an event-ticketing platform with an accent on scalable ETL/ELT, medallion architecture, and Spark performance. Focus on diagnosing multi-system pipeline failures, tuning distributed processing, and designing reliable data delivery with Kafka, dbt, and automated quality contracts.
Location: Remote from Serbia
Salary: Attractive USD compensation
Company
Software development services are delivered for customers in the US and Europe by a distributed organization of approximately 300 professionals across Eastern Europe, North and South America, Armenia, Georgia, and Kazakhstan.
What you will do
- Lead discovery and requirements-gathering sessions with business stakeholders, document source schemas, and define analytics-ready data models.
- Build, optimize, and maintain fault-tolerant ETL/ELT pipelines using reusable dbt macros, incremental models, and snapshot patterns.
- Design bronze, silver, and gold data layers, including foundational tables, star schemas, reporting marts, SLAs, and data quality contracts.
- Tune Spark jobs by optimizing partitions, reducing shuffle, and improving transformation efficiency.
- Implement automated data quality checks with frameworks such as Great Expectations.
- Diagnose Spark, Kafka, and dbt pipeline issues and maintain technical documentation, data model diagrams, and operational runbooks.
Requirements
- At least 5 years of data engineering experience.
- Advanced Python, Spark, and SQL skills.
- Strong experience with AWS and Databricks.
- Experience with Kafka and modern data stack tools such as dbt and Airflow or equivalent.
- Deep understanding of dimensional modeling, star and snowflake schemas, medallion architecture, data warehousing, and lambda, kappa, and lakehouse topologies.
- Strong spoken English at Intermediate level or higher.
Nice to have
- Experience structuring problems for AI assistance and designing pipelines for AI-assisted development.
Culture & Benefits
- 100% remote work from Serbia.
- Full-time schedule of 8 hours per day.
- Long-term project with a customer that is an industry leader in event-ticket sales across Europe and the USA.
- Paid vacation and holidays.
- USD compensation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →