Senior Big Data Engineer (Databricks + Azure)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Big Data Engineer (Databricks/Azure): Designing and maintaining scalable batch and streaming ETL pipelines on the Databricks Lakehouse platform with an accent on data processing optimization and governance. Focus on building bronze-silver-gold architectures, implementing Unity Catalog, and integrating modern AI/BI capabilities.
Location: Must be based in Ukraine (Remote/Office)
Company
is a global IT services company providing high-end software development and digital transformation solutions.
What you will do
- Design, develop, and maintain scalable batch and streaming ETL pipelines on the Databricks Lakehouse platform.
- Build and optimize data processing solutions using PySpark, Python, and SQL.
- Configure and maintain Databricks clusters, SQL Warehouses, and Unity Catalog governance (access control, lineage).
- Design and implement bronze-silver-gold Lakehouse architectures using Delta Lake.
- Develop and deploy data solutions using Databricks Asset Bundles and CI/CD processes.
- Visualize data and provide business insights using Databricks SQL and Power BI.
Requirements
- 5+ years of experience in Data Engineering and designing scalable ETL pipelines.
- Strong expertise in PySpark, Python, and SQL, including performance tuning and optimization.
- Hands-on experience with Databricks, Delta Lake, and Unity Catalog governance.
- Proven experience with CI/CD practices and Databricks Asset Bundles.
- English: Upper-intermediate (B2) or higher required.
- Location: Must be based in Ukraine.
Nice to have
- Familiarity with Databricks AI/BI tools such as MLflow, Dashboards, Metric Views, or Genie.
- Experience with Azure data services (ADF, Synapse, ADLS, Azure DevOps, or Microsoft Fabric).
Culture & Benefits
- Flexible work arrangement with both remote and office options.
- Opportunity to work with a cutting-edge tech stack including Databricks Lakehouse and Azure.
- Inclusive and diverse work environment as an equal opportunity employer.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →