6 дней назад
Senior Data Developer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Developer (Databricks) (Data Engineering): Building and maintaining ETL/ELT processes and trusted data layers for analytics, reporting, and automation with an accent on SQL, PySpark, Python, Azure, Databricks, and data quality. Focus on optimizing Spark workloads, validating production data, automating pipelines, and translating business requirements into scalable technical solutions.
Location: Warsaw, Poland; onsite role
Company
InPost operates a technology-driven out-of-home e-commerce and parcel delivery platform across European markets.
What you will do
- Design, build, and maintain ETL/ELT processes using SQL, PySpark, and Python.
- Develop data layers, tables, views, and data models in Databricks, Data Lake, and Delta Lake.
- Automate and orchestrate data loading and transformation processes.
- Maintain data quality through validation rules, monitoring, alerting, and incident diagnosis.
- Optimize SQL queries, Spark processes, and storage structures for performance, stability, scalability, and cost.
- Document data processes, KPI logic, dependencies, lineage, and incident-handling procedures in Confluence.
Requirements
- At least 2 years of experience in Data Engineering, Analytics Engineering, or data analysis.
- Experience designing ETL/ELT processes, building data models, and maintaining production data processes.
- Practical knowledge of SQL, Python, PySpark, Databricks, Microsoft Azure, Data Lake, and Delta Lake architecture.
- Experience with Git and Azure DevOps across Dev, Test, and Prod environments.
- Ability to translate business requirements into technical solutions and ensure data quality.
- Advanced English required for communication in an international environment.
Nice to have
- Experience in complex operational environments and with dimensional modelling.
- Advanced Databricks and Delta Lake knowledge.
- Experience with Kafka, Structured Streaming, or Event Hubs.
- Knowledge of monitoring, alerting, data security, access control, metadata management, and data lineage.
- Jira and Confluence experience or relevant Microsoft Fabric and Databricks certifications.
Culture & Benefits
- Direct ownership of data products influencing strategic decisions.
- International, diverse, and cross-functional collaboration.
- Opportunity to experiment with AI tooling and bring innovations into production.
- B2B cooperation model.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
13 дней назад
Senior Data Engineer (Databricks)
11 дней назад
Data Engineer (Databricks)
4 400 - 5 200€
13 дней назад
Data Engineer (Databricks)
11 дней назад
Senior Big Data Software Engineer (Databricks + AWS)
13 дней назад
Lead Data Engineer (Databricks)
11 дней назад
Data Engineer (Databricks)
15 120 - 21 000PLN