12 часов назад
Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (Microsoft Fabric/Azure): Building and maintaining scalable data ingestion and transformation pipelines across medallion architecture layers to support enterprise reporting, analytics, and AI use cases with an accent on Python, PySpark, Delta Lake, and data quality. Focus on developing metadata-driven frameworks, optimizing pipeline performance, troubleshooting operational failures, and supporting reliable Power BI datasets.
Location: United States. Candidates must be authorized to work in the United States without current sponsorship.
Company
provides purpose-built enterprise software, including ERP, supply chain management, and compliance solutions for specialized organizations across multiple industries.
What you will do
- Build and maintain data ingestion pipelines using Microsoft Fabric, Dataflows Gen2, Notebooks, and Azure Data Factory.
- Develop Python and PySpark notebooks to cleanse, transform, and enrich data across bronze, silver, and gold layers.
- Implement Delta Lake patterns, including partitioning, schema evolution, incremental loads, and SCD logic.
- Apply data quality checks, troubleshoot pipeline failures and discrepancies, and perform root-cause analysis.
- Develop reusable, metadata-driven, parameterized pipeline frameworks and support gold-layer datasets and Power BI semantic models.
- Participate in code reviews, testing, CI/CD, monitoring, documentation, and on-call operational support.
Requirements
- 3–5 years of experience building production or near-production data pipelines.
- Hands-on experience with Python and PySpark.
- Experience with Azure Data Factory or similar orchestration tools.
- Experience with Microsoft Fabric, or strong Azure Synapse or Databricks experience with willingness to learn Fabric.
- Strong SQL, data modeling, performance optimization, medallion architecture, Delta Lake, data quality, and basic SCD knowledge.
- Familiarity with Git, branching, CI/CD, data governance, and effective collaboration with technical and business stakeholders.
Nice to have
- Exposure to Power BI and semantic data models.
- Understanding of schema versioning and access controls.
Culture & Benefits
- Opportunity to work with Microsoft Fabric, Azure, enterprise data, analytics, and AI initiatives.
- Collaborative environment with experienced data engineering professionals.
- Hands-on learning, growth opportunities, and ownership of impactful projects.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →