Python Data Engineer (Azure)

TL;DR

Python Data Engineer (Azure): Developing and maintaining Microsoft Fabric pipelines and ETL/ELT processes for a leading investment management company with an accent on Azure data services, Spark workflows, and data security. Focus on designing optimized SQL queries, scalable Python code, and collaborating with stakeholders to support business intelligence and analytics.

Location: Hybrid with minimum 3 days per week onsite in Newark, NJ

Salary: $160,000–$180,000 per year

Company

US-based investment management company listed in the Fortune Global 500, offering insurance, investment management, and financial products to retail and institutional clients worldwide.

What you will do

• Develop, deploy, and maintain data pipelines using Azure Data Factory and other Azure services
• Design and optimize SQL queries and stored procedures for performance and accuracy
• Write scalable Python code for data processing and transformation
• Build and maintain Spark and PySpark workflows for large-scale distributed data processing
• Collaborate with data engineers, scientists, and business stakeholders to define data requirements and models
• Implement data security and governance best practices using Azure Security services

Requirements

• 5+ years expert-level SQL experience
• 3+ years strong hands-on Python engineering experience
• 2+ years practical experience with Azure data services, especially Azure Data Factory or Microsoft Fabric
• 2 years practical experience with Apache Spark and PySpark
• Experience with Azure Security services and Azure Portal management
• Knowledge of data warehousing, governance, and management

Nice to have

• Experience with MS SQL, PostgreSQL, Amazon Redshift
• Experience with Java and Scala
• Experience with PowerBI

Culture & Benefits

• Vacation as per local laws with encouragement to rest properly
• Health insurance assistance
• 10 days sick pay without doctor's note, then as per laws
• Time off for state holidays regardless of client schedule
• Corporate parties and social events
• Technical and everyday problem support at work