20 дней назад
Senior Data Engineer (Microsoft Fabric)
120 000 - 140 000NZD
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Microsoft Fabric): Building and deploying production-grade data products and end-to-end ingestion pipelines on Microsoft Fabric with an accent on Medallion Architecture, OneLake, Lakehouses, and governed enterprise data delivery. Focus on implementing PySpark and T-SQL transformations, optimizing Delta Lake workloads, integrating Microsoft Purview metadata and lineage, and validating platform readiness.
Location: Wellington, New Zealand
Salary: NZ$120,000–NZ$140,000 per annum
Company
is recruiting for a data engineering role supporting a critical enterprise public sector environment.
What you will do
- Design, build, and deploy 12 production-grade data products on an existing Microsoft Fabric platform.
- Implement Medallion Architecture across OneLake, Lakehouses, and Data Warehouses.
- Build scalable ingestion and orchestration pipelines using Dataflows Gen2, Fabric Pipelines, PySpark, Notebooks, and integration tools.
- Support data governance through lineage tracking, security controls, and metadata capture with Microsoft Purview.
- Validate capacity setup, workspace configuration, and technical readiness before platform scaling.
Requirements
- Hands-on experience with Microsoft Fabric, including OneLake, Lakehouse, Dataflows Gen2, Fabric Pipelines, DirectLake, and Semantic Models.
- Strong proficiency in PySpark, T-SQL, Python, and Delta Lake optimization techniques such as partitioning, OPTIMIZE, and VACUUM.
- Experience with modern ingestion platforms, metadata-driven pipelines, cloud connectors, ETL/ELT patterns, and Medallion Architecture.
- Practical knowledge of star-schema dimensional modeling and Microsoft Purview for cataloging, sensitivity labeling, and access control.
- Experience in complex enterprise, public sector, structured-change, or data privacy environments.
Nice to have
- Experience with Matillion.
Culture & Benefits
- Permanent position supporting a critical enterprise public sector environment.
- Opportunity for an immediate part-time start leading into full-time work.
Hiring process
- Submit a profile highlighting Microsoft Fabric or Azure Lakehouse projects.
- Include experience leading ingestion design, ETL patterns, and Medallion Architecture implementation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →