pythongitdata engineeringazuredatabrickspysparkdata pipelinesdelta lake
hhВакансия с HeadHunter. Контакт ведёт на hh.ru
Пожаловаться
Зарплата и рынок
ЗП не указана
На похожих ролях по рынку
$3.1к$3.3кмедиана$3.5к
6 в выборке
На международном рынке: $142к/год ($105к - $179к)
76
Хорошая вакансия
развернуть
У роли понятные задачи в инженерии данных, современный стек Azure и Databricks и сильный пакет льгот, но зарплата не указана, а в консалтинге EPAM проекты и клиенты могут меняться.
Кликните для подробной информации
Зарплата не указанаАктуальный стекПонятные задачиСильный пакет льготРабота с клиентами
Оценка от Hirify AI
Мэтч & Сопровод
Покажет вашу совместимость и напишет письмо
Создать профиль и узнать мэтч
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Data Software Engineer (Databricks/Azure): Building and scaling data transformation pipelines in Databricks with PySpark and Python for machine learning teams, with an accent on Delta Lake, Azure data lakes, and data quality. Focus on optimizing large-scale datasets, implementing schema validation and deduplication, and supporting reliable data products for stakeholders.
Location: Remote or hybrid within Kazakhstan; office access in Almaty, Astana, or Karaganda. Relocation opportunities are available within offices in 55+ countries.
Company
Global software engineering and consulting company delivering custom software, product, platform, and AI transformation solutions for enterprises and startups.
What you will do
Support data engineers in building pipelines used by MLOps and machine learning engineering teams.
Develop, optimize, and maintain Databricks data transformation pipelines with PySpark.
Work with data in ADLS Gen2 and SAP HANA Data Lake, primarily using Delta and Parquet formats.
Implement data quality checks, including schema validation, deduplication, enrichment, and tagging.
Collaborate with stakeholders to understand business processes and model input data.
Tune performance for large-scale datasets.
Requirements
3+ years of experience in data engineering or a related field.
Proficiency in Python, PySpark, Databricks, and Delta Lake.
Experience with Git and GitHub, plus CI/CD frameworks such as GitHub Actions.
Knowledge of data lake technologies and experience with Microsoft Azure.
English proficiency at B2 level or higher.
Nice to have
Experience with another programming or scripting language, such as Java, SQL, or Scala.
Culture & Benefits
Remote and office-based work options in Kazakhstan.
Opportunity to work abroad for up to two months per year.
Corporate and social events, leadership development, career advising, and well-being programs.
Professional certifications, internal learning resources, and free English classes.
Employee Stock Purchase Plan, medical and family care package, trust days, psychology session coverage, and other benefits.
Housing support through preferential mortgage access via Otbasy Bank.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →