Senior IT Engineer (Data Engineering)

TL;DR

Senior IT Engineer (Data Engineering): Building and optimizing data pipelines and architectures for a building materials supplier with an accent on ETL processes, Azure cloud services, and SAP integration. Focus on developing high-volume data sets using PySpark and SQL, ensuring data quality through MDM, and implementing CI/CD pipelines via Azure DevOps.

Location: Remote (USA). Position requires 10% domestic travel.

Salary: $157,414 – $162,125

Company

hirify.global is America’s largest supplier of building materials, value-added components, and building services to the professional market.

What you will do

• Lead moderately complex projects from technical design through completion.
• Develop and optimize data pipelines to store, integrate, and process high-volume data sets.
• Execute and test pre-defined ETL processes and troubleshoot data issues impacting delivery.
• Collaborate with Data Scientists to ensure architectural and project specification needs are met.
• Perform data transformations to populate warehouse tables optimized for reporting.
• Act as an on-call SME resource to manage admin failure and messaging events.

Requirements

• Must be based in the USA.
• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Minimum of 6 years (72 months) of experience in a related occupation.
• Proficiency in Python, PySpark, and SQL for data processing and analysis.
• Experience with Azure Cloud Platform (Databricks, Data Factory) and Azure DevOps CI/CD pipelines.
• Experience building integrations with SAP systems (BODS, HANA) and utilizing Delta Lake or Lakehouse architectures.

Nice to have

• Experience with Kafka, SSIS, or Informatica.
• Proficiency in Linux shell scripting and Powershell.
• Knowledge of Master Data Management (MDM) and Data Governance.
• Experience with data modeling tools like ER or Studio Data Architect.

Culture & Benefits

• Comprehensive medical, dental, vision, and disability insurance plans.
• 401(k) retirement savings plan.
• Paid Time Off (PTO), including paid sick time, and 8 paid holidays per year.
• Strong focus on professional development with access to the latest training and tools.
• Collaborative, people-first work environment.