pythonsqlkafkadata engineeringetlci cdairflowazure data factorypysparkelt
hhВакансия с HeadHunter. Контакт ведёт на hh.ru
Пожаловаться
Зарплата и рынок
развернуть
По рынку СНГ данных пока нет
На международном рынке: $155к/год ($92к - $180к)
85
Отличная вакансия
развернуть
Хорошо структурированная вакансия уровня Senior в крупной международной компании с современным стеком технологий и широкими возможностями для профессионального развития.
Современный стек
Возможности роста
Глобальная мобильность
?Аутсорсинговая модель
Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Создать профиль и узнать мэтч
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Data Integration Engineer (Cloud Data Engineering): Building scalable batch and near-real-time ETL/ELT pipelines, data warehouse and lakehouse layers, and automated data quality frameworks with an accent on Python, PySpark, SQL, cloud integration tools, and orchestration. Focus on designing Source-to-Target Mappings, implementing CDC and streaming workflows, optimizing analytical databases, and building reliable CI/CD pipelines for data products.
Location: Remote from anywhere in Georgia; the listing also specifies Astana as the city/region.
Company
EPAM delivers software engineering and data solutions for industry-leading clients.
What you will do
Design, build, optimize, and modernize scalable batch and near-real-time ETL/ELT pipelines using Python, PySpark, SQL, and cloud integration engines.
Develop workflow orchestration and automated ingestion routines with Apache Airflow or cloud-native schedulers.
Design data warehouse and lakehouse layers using platforms such as Snowflake, ClickHouse, Azure Synapse, or Redshift, including partitioning, indexing, and SCD Type 2 patterns.
Establish data quality checks and validation frameworks with dbt, Soda, or PySpark testing suites.
Collaborate with product owners, business analysts, and architects on data requirements, technical constraints, Source-to-Target Mappings, and architecture decisions.
Lead code reviews, maintain CI/CD pipelines with Docker, and produce technical specifications, lineage documentation, architecture diagrams, and data dictionaries.
Requirements
5+ years of hands-on experience in data engineering, data warehousing, database design, and end-to-end data integration.
Advanced knowledge of cloud integration tools such as Azure Data Factory, AWS Glue, or GCP Dataflow.
Proficiency with Apache Airflow and exposure to Change Data Capture or real-time streaming tools such as Kafka and Debezium.
Production-level coding skills in SQL, Python, and PySpark or Apache Spark, including advanced SQL optimization and stored procedures.
Experience with analytical databases and cloud-native systems such as Snowflake, ClickHouse, PostgreSQL, MS SQL Server, or Azure Synapse.
Master-level understanding of OLAP, OLTP, star and snowflake schemas, Delta Lake/lakehouse patterns, and data staging.
Hands-on experience with Git and automated CI/CD deployment pipelines for data products.
Ability to explain complex technical concepts clearly to business stakeholders and developers.
Fluent English at Upper-Intermediate level or higher is required.
Nice to have
Deep knowledge of dbt and schema validation practices.
Experience with Docker or Kubernetes for packaging and deploying data applications.
Experience building serverless ingestion services with AWS Lambda, Azure Functions, and RESTful APIs.
Culture & Benefits
Remote work from Georgia, with the option to work from company offices.
Opportunity to work abroad for up to two months per year.
Relocation opportunities within offices in 55+ countries.
Leadership development, career advising, soft-skills and well-being programs, certifications, internal learning resources, and free English classes.
Employee Stock Purchase Plan, referral bonuses, medical and family care, five trust days per year, and additional lifestyle benefits.
Corporate and social events with an environment focused on collaboration and innovation.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →