12 дней назад
Senior Data Engineer (Azure Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Azure Databricks): Design and build a governed enterprise data platform on Azure Databricks, Unity Catalog, and Delta Lake with an accent on scalable ELT/ETL pipelines, data modelling, and governance. Focus on implementing medallion architecture, PII classification and masking, CI/CD for data platforms, and mentoring engineers while supporting SAP and manufacturing data flows.
Location: George Town, Penang, Malaysia; onsite only
Company
is an embedded semiconductor solution provider serving the automotive, industrial, infrastructure, and IoT markets.
What you will do
- Design and build a governed enterprise data platform on Azure Databricks, Unity Catalog, and Delta Lake.
- Define data catalog domains, schemas, naming conventions, and structures with functional teams.
- Shape source-specific ingestion strategies using CDC, file-based ingestion, Fivetran, SAP Datasphere, and ADF.
- Model data through the Landing, Bronze, Silver, Silver Final, and Gold medallion layers.
- Build scalable Spark-based ELT/ETL pipelines and ensure data quality, performance, and security.
- Drive governance, CI/CD, DevOps practices, design reviews, and architectural decisions while mentoring junior engineers.
Requirements
- Strong experience with Spark, Delta Lake, distributed processing, advanced SQL, and Python.
- Hands-on experience with Databricks and Unity Catalog, including data modelling, orchestration, and medallion architecture.
- Knowledge of data governance, PII classification and masking, Entra ID entitlements, and data privacy regulations including GDPR and APPI.
- Familiarity with SAP S/4HANA and Datasphere and FI, CO, SD, MM, PP, and GL domains.
- Understanding of manufacturing and supply-chain business flows, plus experience with Oracle, SQL Server, CDC ingestion, Git, and Jira.
- Must work onsite in George Town, Penang, Malaysia; remote work is not available.
Culture & Benefits
- Work with a global organization of more than 21,000 engineers and problem solvers across over 30 countries.
- Collaborative culture grounded in transparency, agility, global collaboration, innovation, and entrepreneurship.
- Contribute to semiconductor technology for automotive, industrial, infrastructure, and IoT applications.
- Competitive benefits package provided alongside the salary.
- Equal opportunity workplace committed to diversity and inclusion.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →