Назад
Company hidden
обновлено 7 дней назад

Senior Data Engineer (GCP)

Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify RU Global, списка компаний с восточно-европейскими корнями
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (GCP): Architecting and optimizing scalable data infrastructure and ETL/ELT pipelines on Databricks and BigQuery with an accent on workflow orchestration and data quality enforcement. Focus on designing robust, cost-effective data streaming architectures using Airflow, dbt, and containerization technologies like Kubernetes.

Location: Not specified

Company

hirify.global is an experience design and technology partner delivering digital products and technology solutions for clients of different sizes.

What you will do

  • Define and implement data architecture on GCP, including BigQuery and Databricks warehouses, Google Cloud Storage data lakes, and Data Mart environments.
  • Design, build, and optimize batch and real-time ETL/ELT pipelines using Apache Airflow, dbt, Dataflow, Pub/Sub, and BigQuery.
  • Develop event-driven and asynchronous workflows between microservices using RabbitMQ, Docker, and Kubernetes.
  • Implement Terraform-based infrastructure management and CI/CD pipelines for data engineering components.
  • Establish data quality, metadata, lineage, auditing, security, and compliance practices using Great Expectations and related frameworks.
  • Collaborate with Data Science, Analytics, and Product teams to support machine learning, reporting, and advanced analytics.

Requirements

  • 3+ years of professional data engineering experience, including at least 1 year working with mobile data.
  • Strong experience with BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, Pub/Sub, and Data Mart solutions.
  • Strong programming skills in Python, Java, or Scala, plus scripting for automation.
  • Experience with Docker, Kubernetes, CI/CD, and DevOps tools such as Terraform, Ansible, Jenkins, or GitLab CI.
  • Knowledge of Great Expectations, data lineage, metadata management, GDPR or CCPA compliance, and OLTP/OLAP systems.
  • Excellent communication, organization, self-motivation, and problem-solving skills.

Culture & Benefits

  • Long-term contract-based collaboration.
  • Competitive compensation based on experience and expertise.
  • Collaborative and open working environment.
  • Flexible collaboration arrangements.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →