4 дня назад
Lead Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (Azure Databricks/Spark): Building scalable cloud-based data platforms, pipelines, lakes, warehouses, and analytics infrastructure with an accent on Delta Lake architecture, data governance, and platform reliability. Focus on optimizing distributed data environments, implementing CI/CD workflows, and supporting reporting, analytics, and AI initiatives.
Location: Bangalore, India; hybrid working model
Company
powers the future of travel through global technology, data, and travel solutions.
What you will do
- Design, develop, and maintain data pipelines for ingestion, transformation, and delivery.
- Build and optimize cloud-based data platforms with Azure Databricks, Apache Spark, and related technologies.
- Implement Delta Lake bronze, silver, and gold layer architectures and maintain data lakes, warehouses, and analytics platforms.
- Apply data governance and security practices while ensuring data quality and performance.
- Monitor production systems, troubleshoot distributed data environments, and improve platform reliability.
- Contribute to reporting, analytics, and AI initiatives and support technical knowledge sharing.
Requirements
- Substantial experience in data engineering and big data technologies.
- Hands-on experience with Azure Databricks, Apache Spark, and data pipeline frameworks.
- Knowledge of Delta Lake architecture, Azure Data Lake Storage, Data Factory, and related Azure services.
- Experience implementing CI/CD for data engineering workflows.
- Understanding of data governance, security, distributed systems troubleshooting, and Agile methodologies.
- Strong collaboration, communication, and problem-solving skills.
Culture & Benefits
- Hybrid working model.
- Learning through on-the-job training, formal activities, and collaboration with colleagues.
- Supportive environment focused on career development and personal and family life.
- Diverse and inclusive community with a commitment to equal opportunity and accessible recruitment.
- Work connected to the future of travel and a global business mission.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →