Middle Data Engineer (Azure Databricks)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Middle Data Engineer (Azure Databricks): Designing and developing modern data pipelines and Lakehouse architectures using Azure Databricks, Spark, and Azure Data Factory with an accent on scalable cloud-based data architectures. Focus on optimizing data transformations with PySpark and SQL, implementing Delta Lake, and integrating diverse data sources for advanced analytics.
Location: Katowice, Poland. Work From Anywhere culture (Remote); Relocation program available to Poland.
Company
is a global IT services and consulting company that supports digital transformation for some of the world's largest enterprises.
What you will do
- Design, develop, and maintain data pipelines using Azure Databricks.
- Build and optimize data transformations using PySpark and SQL.
- Implement and maintain Lakehouse architectures using Delta Lake.
- Develop ETL/ELT pipelines orchestrated through Azure Data Factory.
- Integrate data from multiple sources into the data platform and analytical layers.
- Collaborate with BI teams to support Power BI and reporting platforms.
Requirements
- 3+ years of experience in Data Engineering or Data Warehouse development.
- Experience with Azure Databricks, PySpark, and Spark SQL.
- Solid understanding of distributed data processing and big data concepts.
- Experience working with Delta Lake and Lakehouse architectures.
- Strong SQL skills and experience with SQL Server relational databases.
- Experience building data pipelines using Azure Data Factory.
Nice to have
- Experience with Spark optimization techniques (partitioning, caching, cluster tuning).
- Experience with structured streaming in Databricks.
- Knowledge of CI/CD pipelines for data platforms (Azure DevOps).
- Familiarity with Power BI.
- Experience in migrating from traditional ETL processes to cloud architectures.
Culture & Benefits
- Work From Anywhere culture providing high flexibility.
- Competitive compensation package including health insurance.
- Relocation program for eligible candidates.
- Professional development opportunities, including certification programs and mentorship.
- Inclusive multicultural environment with regular team-building and social events.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →