обновлено 2 дня назад
Mid Data Engineer (Barcelona hybrid)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Mid Data Engineer (Databricks/Snowflake): Operating and migrating production data pipelines from Databricks to Snowflake using dbt and Airflow with an accent on pipeline reliability, data quality, and cross-platform table sharing. Focus on reverse-engineering undocumented transformation logic, validating equivalent outputs, optimizing Snowflake performance and cost, and communicating technical incidents to client stakeholders.
Location: Barcelona, hybrid
Company
is a global AI-native technology solutions provider developing AI-powered digital products and platforms for clients.
What you will do
- Operate production Databricks pipelines covering ingestion, transformation, and delivery to downstream consumers.
- Diagnose pipeline failures and data quality issues, reverse-engineer undocumented transformation logic, and document business rules.
- Migrate legacy tables from Hive Metastore to Unity Catalog and maintain Iceberg-enabled sharing between Databricks and Snowflake.
- Build and test dbt models, including incremental materializations and data tests, and develop Airflow DAGs for orchestration.
- Validate migrated pipeline outputs and contribute to Snowflake modeling, performance, and cost decisions.
- Work directly with client stakeholders on technical topics alongside the team lead.
Requirements
- 3+ years of experience operating production data pipelines.
- Strong SQL and practical Python skills for scripting, automation, and API integration.
- Experience with Databricks, PySpark, Delta Lake, Databricks Workflows, Unity Catalog, Snowflake, dbt, and Airflow.
- Knowledge of incremental loading, idempotency, late-arriving data, reprocessing, and production troubleshooting.
- Working knowledge of AWS S3 and IAM, plus basic familiarity with Redshift.
- Fluent English required for client-facing communication with stakeholders based abroad.
Nice to have
- Experience with platform migrations, undocumented systems, or system stabilization.
- Experience with Iceberg, cross-platform sharing, or other open table formats.
- Experience with clickstream or web analytics data, including Adobe Analytics, Google Analytics, or Segment.
- Proficiency with AI tools for drafting, analysis, research, or process automation.
Culture & Benefits
- High-impact environment focused on client outcomes.
- Commitment to professional development.
- Flexible and collaborative culture.
- Global opportunities and a vibrant community.
- Total rewards, with specific benefits determined by employment type and location.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →