6 дней назад
Senior Data Engineer (Databricks & PySpark)
38€
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Databricks & PySpark): Design, build, and operate a Sustainability Data Foundation with an accent on scalable data products, auditable pipelines, data quality, and regulatory reporting. Focus on optimizing Databricks workloads, implementing CI/CD and Infrastructure as Code, and solving complex data governance and reliability challenges.
Location: 100% remote from Warsaw, Poland
Rate: Up to 38 EUR per hour
Company
is a recruitment and consulting company providing project-based and permanent opportunities for clients in Poland and abroad.
What you will do
- Design, build, and operate the Sustainability Data Foundation on Databricks.
- Develop scalable data products and pipelines with Databricks, Delta Lake, and PySpark.
- Process complex data from ERP, procurement, sustainability, and external systems.
- Optimize workloads for performance, scalability, and cost efficiency.
- Implement automated data quality controls, CI/CD pipelines, testing, deployments, and Infrastructure as Code.
- Collaborate with sustainability experts, business analysts, and reporting teams on requirements, solution design, and production releases.
Requirements
- 5–7 years of experience designing, developing, and operating data platforms and pipelines.
- Extensive production experience with Databricks, including Azure Databricks and Databricks Workflows.
- Expert proficiency in PySpark, Python, Spark SQL, data modeling, and data pipeline design.
- Experience with Git-based development, version control, CI/CD, data lineage, metadata management, governance, auditing, and validation frameworks.
- Fluent English required in written and spoken communication.
- Proactive approach with strong troubleshooting and root-cause analysis skills.
Nice to have
- Experience with sustainability reporting, ESG data, and regulatory reporting.
- Knowledge of procurement, supplier, finance, and ERP data domains.
- Experience developing Databricks applications, dashboards, or user-facing data tools.
Culture & Benefits
- Full-time schedule of 40 hours per week.
- B2B cooperation agreement signed directly with .
- Focus on reliability, operational excellence, and practical solutions.
- Opportunity to work on sustainability data, regulatory compliance, and advanced analytics.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →