Principal Data Lake Engineer (Data Engineering)

TL;DR

Principal Data Lake Engineer (Data Engineering): Leading the design and optimization of scalable data lake systems with an accent on data governance, metadata management, and schema-on-read solutions. Focus on mentoring engineering teams and contributing to open source data lake projects.

What you will do

• Contribute actively to data lake and related open source projects as a core contributor.
• Design and optimize data lake architectures for large-scale data storage and processing.
• Architect advanced schema-on-read solutions to enable flexible and efficient data access.
• Lead data governance initiatives to ensure enterprise-level data quality and compliance.
• Drive metadata management system development for comprehensive data discovery and lineage.
• Mentor engineering teams and provide technical leadership across projects.

Requirements

• 10+ years of experience in software development.
• Strong expertise in data lake architectures and large-scale data storage systems.
• Deep understanding of advanced schema-on-read concepts and flexible data modeling.
• Proficiency in enterprise data governance frameworks and compliance management.
• Proven experience with metadata management and large-scale data cataloging systems.
• Core contributions to Apache open source projects (Iceberg, Delta Lake, Hudi, or similar).
• Advanced level of English.