TL;DR

Azure Databricks with PYSPARK Developer: Designing and developing data processing components for big data and distributed computing environments with an accent on ETL processes, data ingestion, curation, and CI/CD implementation using Azure DevOps. Focus on solution/technical design in the Azure Cloud and managing big data/database in the cloud.

Location: AIA Pune, India (Hybrid - 3 days from office)

Company

%hirify_global% is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era.

What you will do

Design and develop data processing components using Databricks, Azure Data Factory, Azure SQL DB/DW, and HDInsight.
Perform analysis, design, and development of ETL processes to support project requirements.
Implement CI/CD pipelines using Azure DevOps.
Develop scripts using Shell, Python, and Scala.

Requirements

Minimum 6 to 13 years of experience in IT.
At least 4 years of experience in Big Data/Distributed computing implementation as a developer.
Working knowledge of Data Warehousing concepts and design.
Experience with solution/technical design in the Azure Cloud.
Familiarity with data management, data ingestion, capture, processing, and curation using Databricks Delta tables, Pyspark, and Scala.

Culture & Benefits

Work within a high-caliber team that appreciates and supports one another.
Uphold an energetic, collaborative, and inclusive workplace.
Join a global community with more than 300,000 associates.
Foster an innovative environment to build your career path.
%hirify_global% is an equal opportunity employer.

Azure Databricks With PYSPARK