Python Data Engineer (Azure)

TL;DR

Python Data Engineer (Azure, Investment Management): Building and optimizing Microsoft Fabric pipelines and ETL/ELT processes for a leading investment management company with an accent on data accuracy and scalability. Focus on designing, implementing, and maintaining data infrastructure, optimizing SQL queries, and ensuring data security in distributed environments.

Location: Hybrid in Newark, NJ, requiring a minimum of 3 office visits per week. This role is for candidates based in the USA.

Salary: $160,000–$180,000 USD per year

Company

hirify.global is a global technology consulting firm providing custom software solutions to clients, including a US-based Fortune Global 500 investment management company.

What you will do

• Develop, deploy, and maintain data pipelines using Azure Data Factory and other Azure data services.
• Design, implement, and optimize SQL queries and stored procedures for high performance and data accuracy.
• Write efficient, scalable Python code for data processing, transformation, and analysis tasks.
• Build and maintain Spark and PySpark workflows for large-scale data processing in distributed environments.
• Collaborate with data engineers, data scientists, and business stakeholders to define data requirements and design data models.
• Ensure data security and governance by implementing best practices using Azure Security services and managing access controls.

Requirements

• 5+ years of expert-level SQL experience.
• 3+ years of strong hands-on Python engineering experience.
• 2+ years of practical experience with Azure data services, especially Azure Data Factory or Microsoft Fabric.
• 2 years of practical experience with Apache Spark, especially PySpark.
• Experience working with Azure Security services and managing via Azure Portal.
• Knowledge and practical experience in data warehousing, data governance, and data management.

Nice to have

• Practical experience with MS SQL, PostgreSQL, or Amazon Redshift.
• Experience with Java and Scala.
• Experience with PowerBI.

Culture & Benefits

• Vacation and sick pay provided as per the laws of your country.
• Health insurance assistance for you and your loved ones.
• Time off for state holidays, regardless of the client’s schedule.
• Enjoy two large corporate parties and various small team get-togethers.
• Benefit from comfort service for technical and everyday work problems.
• Opportunities for career growth, IT certifications, and access to learning platforms.