3 дня назад
Senior Big Data Engineer (Databricks)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Big Data Engineer (Databricks/Azure): Building scalable batch and streaming data pipelines and Lakehouse solutions on Databricks in Azure environments with an accent on PySpark, Python, SQL, Delta Lake, and data governance. Focus on optimizing data platforms, implementing Unity Catalog access control and lineage, deploying solutions through CI/CD, and supporting Databricks AI/BI capabilities.
Location: Ukraine; work format: remote or office
Company
delivers engineering and technology solutions across data and analytics projects.
What you will do
- Design, develop, and maintain scalable batch and streaming ETL pipelines on the Databricks Lakehouse platform.
- Build and optimize data processing solutions with PySpark, Python, SQL, Delta Lake, and bronze–silver–gold Lakehouse architectures.
- Configure Databricks clusters and SQL Warehouses and expose data through Databricks SQL and Power BI.
- Implement Unity Catalog governance, including fine-grained access control, lineage, and cross-workspace data sharing.
- Deploy end-to-end data solutions using Databricks Asset Bundles and CI/CD practices.
- Collaborate with technical and business stakeholders, participate in architecture discussions, and support Databricks AI/BI capabilities.
Requirements
- 5+ years of experience in data engineering, including data modeling and scalable ETL pipeline design.
- Strong expertise in PySpark, Python, and SQL, including performance tuning and optimization.
- Hands-on experience with Databricks clusters, SQL Warehouses, Unity Catalog, Delta Lake, and Lakehouse architecture.
- Experience delivering data solutions with Databricks Asset Bundles, CI/CD, Databricks SQL, and BI tools such as Power BI.
- Strong communication and collaboration skills with technical and business stakeholders.
- Upper-intermediate or higher English.
Nice to have
- Familiarity with Databricks AI/BI tools such as MLflow, Dashboards, Metric Views, Genie, or agents.
- Experience with Azure data services such as ADF, Synapse, ADLS, Azure DevOps, or Microsoft Fabric.
Culture & Benefits
- Remote or office work format in Ukraine.
- Participation in continuous improvement and architecture initiatives.
- Equal opportunity employment regardless of protected personal characteristics.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →