28 минут назад
Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Databricks/AWS): Building and maintaining scalable AWS and Databricks data platforms and ETL/ELT pipelines with an accent on Lakehouse architecture, Snowflake, Delta Lake, and data governance. Focus on optimizing distributed data workloads, designing Gold-layer dimensional models, tuning database performance, and implementing automated data quality checks in CI/CD pipelines.
Location: Not specified
Company
provides AI-led cloud migration, managed services, and consulting across AWS and Salesforce, serving clients through offices in EMEA and North America.
What you will do
- Develop and maintain complex ETL/ELT pipelines with Python, PySpark, Databricks, and Snowflake.
- Implement Medallion architecture using Delta Lake and manage Databricks SQL Warehouses.
- Use AWS services for data storage, compute, and secure data movement.
- Perform database administration, query optimization, indexing, clustering, vacuuming, and performance tuning.
- Design Gold-layer Star Schema and Snowflake data models for Power BI and Tableau.
- Manage metadata, permissions, lineage, and automated data quality checks across CI/CD data pipelines.
Requirements
- 5+ years of professional experience as a Data Engineer or Data Engineer/DBA.
- Strong hands-on experience with AWS, including S3, IAM, and EC2, and with Snowflake.
- At least 1 year of intensive hands-on Databricks experience, including Notebooks and Workflows.
- High proficiency in PySpark or Spark Scala and advanced SQL, including window functions and CTEs.
- Practical experience with Delta Lake, Parquet, AWS S3 or Azure ADLS, and Fact and Dimension table design.
- Ability to work independently, troubleshoot distributed processes and database bottlenecks, and collaborate with analysts, product managers, and data scientists.
Nice to have
- Experience with Delta Live Tables or dbt on Databricks or Snowflake.
- Familiarity with MLOps concepts and MLflow.
- AWS, Snowflake, or Databricks certifications.
- Experience with Apache Airflow or other external orchestration tools.
Culture & Benefits
- Work in an Agile environment with end-to-end ownership of data engineering tasks.
- Collaborate with analysts, product managers, and data scientists across cloud and data initiatives.
- Join a global organization serving clients across EMEA and North America.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
3 дня назад
Senior Big Data Software Engineer (Databricks + AWS)
4 дня назад
Senior Data Engineer
3 дня назад
Data Engineer (Databricks)
4 400 - 5 200€
6 дней назад
Senior Data Engineer (Databricks/Azure)
3 дня назад
Forward Deployed Data Engineer (Databricks)
180 000 - 230 000$
4 дня назад