3 дня назад
Senior Data Engineer (Microsoft Data & AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Microsoft Data & AI): Building end-to-end Azure data platforms, production-grade pipelines, APIs, and MCP integrations for analytics, Data Agents, and generative AI applications with an accent on lakehouse architecture, data modeling, governance, and activation. Focus on designing scalable batch and streaming systems, exposing governed enterprise data to agentic interfaces, optimizing performance and cost, and leading technical delivery for client engagements.
Location: Remote, Toronto, Ontario, Canada
Company
delivers Microsoft-based data, AI, and customer experience solutions through a global Microsoft Partner Practice.
What you will do
- Lead the architecture and delivery of end-to-end Azure data platforms covering ingestion, transformation, analytics, and activation.
- Build production-grade batch and streaming pipelines with Azure Data Factory, Microsoft Fabric, Azure Databricks, PySpark, Python, and SQL.
- Design Medallion lakehouse architectures, data models, APIs, and data services for analytics and downstream applications.
- Create MCP and API integrations for front-line systems, Fabric/Copilot Data Agents, and generative AI interfaces.
- Implement governance, access control, metadata, and lineage with Microsoft Purview and/or Unity Catalog.
- Mentor engineers, guide technical designs, support production incidents, and communicate architecture decisions to client stakeholders.
Requirements
- 5–8 years of experience in data engineering, including ownership of production data pipelines on Azure.
- Expert proficiency in Python, SQL, and PySpark for distributed data pipelines.
- Hands-on experience with Azure Data Factory, Microsoft Fabric, Synapse, ADLS Gen2, Azure Databricks, Delta Lake/OneLake, and Medallion architecture.
- Strong knowledge of data modeling, schema design, enterprise data architecture, orchestration, CI/CD, and Azure DevOps.
- Experience designing APIs and MCP-based integrations for Data Agents and agentic AI interfaces.
- Ability to mentor engineers, lead client-facing technical discussions, troubleshoot large-scale data issues, and explain technical trade-offs clearly.
Nice to have
- Bachelor’s or Master’s degree in Computer Science, Engineering, Mathematics, Statistics, or a related technical discipline.
- Microsoft certifications such as Azure Data Engineer Associate or Fabric Analytics Engineer Associate.
- Databricks certifications.
Culture & Benefits
- Remote work arrangement.
- Work with a Microsoft Partner Practice of more than 100 data and AI experts.
- Exposure to client engagements, reusable engineering frameworks, and Microsoft Fabric and Azure Databricks capabilities.
- Inclusive workplace and equal employment opportunity commitment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →