Senior Developer (Azure Databricks, PySpark)

TL;DR

Senior Developer (Azure Databricks, PySpark): Developing and maintaining scalable data solutions for enhanced data accessibility and security with an accent on Databricks Unity Catalog, Azure Data Lake Store, and Azure DevOps integration. Focus on designing efficient data processing pipelines using Python and PySpark, managing Databricks SQL queries, and ensuring data quality and integrity for business intelligence and analytics initiatives.

Location: This is a hybrid role, requiring work during the day shift and based in Pune, India.

Company

hirify.global is one of the world's leading professional services companies, transforming clients' business, operating, and technology models for the digital era, headquartered in the U.S.

What you will do

• Develop and maintain scalable data solutions using Databricks Unity Catalog and Azure Data Lake Store.
• Collaborate with cross-functional teams to integrate Azure DevOps into the development lifecycle.
• Utilize Python and PySpark to design and implement efficient data processing pipelines.
• Create and manage Databricks SQL queries to support business intelligence and analytics initiatives.
• Oversee Databricks Workflows and ensure timely, accurate data processing and quality.
• Analyze complex data sets to identify trends and insights for data-driven decision-making.

Requirements

• 7 to 10 years of experience as a developer.
• Proficiency in Databricks Unity Catalog, Azure Data Lake Store, and Azure DevOps.
• Strong programming skills in Python and PySpark for data processing and analysis.
• Experience in Databricks SQL and Workflows for data management and analytics.
• Ability to work in a hybrid model in Pune, India.
• English B2+ required.
• Certifications: Databricks Certified Data Engineer Associate, Microsoft Certified: Azure Data Engineer Associate.

Nice to have

• Background in Data Management, Hedge Fund Accounting, or Account Management.

Culture & Benefits

• Energetic, collaborative, and inclusive workplace.
• Opportunities for career path development within a global community of over 300,000 associates.
• Focus on innovation and doing what's right for people, clients, company, communities, and climate.

Hiring process

• Applicants may be required to attend interviews in person or by video conference.
• Candidates may be required to present their current state or government-issued ID during each interview.