обновлено 1 день назад
Senior Big Data Engineer (Databricks + Azure)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Big Data Engineer (Databricks + Azure): Building scalable batch and streaming data pipelines on the Databricks Lakehouse platform in Azure environments with an accent on PySpark, Python, SQL, governance, and Delta Lake architecture. Focus on optimizing data processing, configuring clusters and SQL Warehouses, deploying solutions through CI/CD, and supporting Databricks AI/BI capabilities.
Location: Poland or Bulgaria; remote or office work
Company
delivers engineering and technology services, including data and analytics solutions.
What you will do
- Design, develop, and maintain scalable batch and streaming ETL pipelines on Databricks Lakehouse.
- Build and optimize data processing solutions with PySpark, Python, and SQL.
- Configure Databricks clusters and SQL Warehouses.
- Implement Unity Catalog governance, including access control, lineage, and data sharing.
- Develop and deploy data solutions with Databricks Asset Bundles and CI/CD processes.
- Design bronze–silver–gold Lakehouse architectures and expose data through Databricks SQL and Power BI.
Requirements
- 5+ years of experience in data engineering, including data modeling and scalable ETL pipeline design.
- Strong expertise in PySpark, Python, and SQL, including performance tuning and optimization.
- Hands-on Databricks experience with clusters, SQL Warehouses, Unity Catalog, Delta Lake, and Lakehouse architecture.
- Experience delivering end-to-end solutions with Databricks Asset Bundles and CI/CD.
- Experience with Databricks SQL and BI tools such as Power BI.
- Upper-intermediate English or higher; role available in Poland or Bulgaria.
Nice to have
- Familiarity with Databricks AI/BI tools, including MLflow, Dashboards, Metric Views, Genie, or agents.
- Experience with Azure data services such as ADF, Synapse, ADLS, Azure DevOps, or Microsoft Fabric.
Culture & Benefits
- Collaboration with technical and business stakeholders across different project lifecycle stages.
- Participation in architecture discussions and continuous improvement initiatives.
- Opportunity to work with modern Databricks AI/BI capabilities.
- Remote or office work format.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →