Senior Data Engineer (Scala)(Fintech)

TL;DR

Senior Data Engineer (Scala)(Fintech): Development and maintenance of the analytical platform B2C with an accent on architecture and development of the framework for building batch and streaming showcases. Focus on ensuring high performance and scalability of the platform on petabyte data volumes, and designing abstractions and APIs to simplify data work.

Location: Москва (м. Кутузовская). Только офисный формат работы.

Salary: 300 000 —‍ 450 000 ₽/‍мес на руки

Компания

Sberbank is the largest bank in Russia, Central and Eastern Europe, and one of the leading international financial institutions.

Что делать

• Participate in the design and development of the architecture of the framework for building batch and streaming showcases.
• Develop the platform core and its components (orchestration, metadata, Data Quality framework) in Scala/Java.
• Create and optimize abstractions and APIs (including RESTful) that simplify data work for other teams.
• Conduct performance and scalability testing of the platform on large data volumes (petabytes).
• Work closely with platform users (analysts, data engineers from business teams) to gather requirements and feedback.
• Mentor junior developers.

Требования

• Deep knowledge of Scala or Java, SQL, Bash.
• Experience with Apache Spark (required). Experience with Flink, Kafka, Iceberg or similar.
• Understanding of DWH/Data Lake, ETL/ELT processes, SCD, Data Quality.
• Experience in designing fault-tolerant and scalable systems, understanding SOLID, experience in writing tests (unit, integration).
• Experience in cross-functional interaction, architectural decision-making, mentoring.

Хорошо, если есть

• Experience with the Hadoop ecosystem (HDFS, YARN, Hive).
• Knowledge of Trino/Velox.
• Experience with microservice architecture and REST API.
• Experience with ClickHouse, Kubernetes, S3.
• Knowledge of Python.

Культура и преимущества

• Work in the office at Moscow, Kutuzovsky Prospekt 32k1.
• Annual bonus and annual review.
• Extended health insurance from the first day + dentistry and preferential insurance for the family.
• Sber Corporate University, internal educational platform, participation in IT conferences.
• Office on Kutuzovsky Prospekt 32 with a view of the embankment, recreation areas and a gym.
• Preferential mortgage in Sber, corporate pension program, SberPrime+ subscription, discounts from partners and services of the group of companies.