обновлено 4 дня назад
Data Engineer 3 (Scala/Spark)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer 3 (Scala/Spark): Designing, deploying, and maintaining data marts, ETL processes, and scalable data assets with an accent on Apache Spark, big data technologies, Azure, and Databricks. Focus on building production-quality data systems, defining quality indicators and monitoring, and troubleshooting reliability and performance issues.
Location: Bangalore, India
Company
is a travel technology company focused on technology-driven solutions and global innovation.
What you will do
- Design, implement, deploy, and maintain data marts, ETL processes, and data systems.
- Ensure the reliability, scalability, and performance of data assets.
- Define quality indicators and build monitoring and alerting mechanisms.
- Troubleshoot and document issues according to standards.
- Continuously improve data-related systems, processes, security practices, and engineering standards.
Requirements
- Production-quality development experience with Scala, PySpark, or Java.
- Hands-on experience with Apache Spark, Hadoop, Kafka, Impala, and the MapR filesystem.
- Experience with Bash, Python, SQL, database technologies, data modeling, and ETL process design.
- Experience with Maven or SBT and software design under Agile frameworks such as Scrum, Kanban, or SAFe.
- Hands-on experience with Microsoft Azure and Databricks.
- Good English verbal and written communication skills.
Nice to have
- Experience with MongoDB or other NoSQL databases.
- Experience building and maintaining DevOps pipelines.
- Familiarity with Tableau, Snowflake Data Cloud, and Databricks SQL.
Culture & Benefits
- Skills development and opportunities to try new ideas.
- Global and diverse work environment.
- Collaborative, multicultural workplace with opportunities to work on changing customer-driven project needs.
- Inclusive employee experience and equal-opportunity employment environment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →