8 часов назад
Senior Data Engineer (AWS/Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (AWS/Databricks): Designing, developing, and maintaining a cloud data platform based on AWS, Databricks, Snowflake, and Delta Lake with an accent on scalable ETL/ELT pipelines, data architecture, and performance tuning. Focus on implementing Medallion architecture, optimizing distributed data workloads, designing analytical data models, and automating data quality within CI/CD pipelines.
Company
provides AI-led professional and managed cloud services, including AWS migrations, Salesforce implementations, and ongoing cloud management.
What you will do
- Design, develop, and maintain complex ETL/ELT pipelines using Python, PySpark, Databricks, and Snowflake.
- Implement Medallion architecture with Bronze, Silver, and Gold data layers using Delta Lake.
- Manage Databricks SQL Warehouses, optimize queries, and support data exploration and analytics.
- Use AWS services for data storage, compute, and secure data movement.
- Perform DBA responsibilities and performance tuning, including indexing, clustering, vacuuming, query profiling, and partition pruning.
- Build analytical data models, manage governance, and integrate automated data quality tests into CI/CD pipelines.
Requirements
- 5+ years of professional experience as a Data Engineer or Data Engineer/DBA.
- Strong hands-on experience with AWS services such as S3, IAM, and EC2, plus Snowflake.
- At least 1 year of intensive hands-on Databricks experience, including Notebooks and Workflows.
- High proficiency in PySpark or Spark Scala and advanced SQL, including window functions and CTEs.
- Experience with Delta Lake, Parquet, AWS S3 or Azure ADLS, and fact and dimension data modeling.
- Ability to troubleshoot distributed processes and database bottlenecks, work independently, and collaborate with analysts, product managers, and data scientists.
Nice to have
- Experience with Delta Live Tables or dbt.
- Familiarity with MLOps concepts and MLflow.
- AWS, Snowflake, or Databricks certifications.
- Experience with Apache Airflow or other external orchestration tools.
Culture & Benefits
- Work in an Agile environment with end-to-end ownership of tasks.
- Collaborate with stakeholders across data, product, and analytics functions.
- Join a global organization serving clients through offices in EMEA and North America.
- Employment is subject to equal opportunity principles.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →