обновлено 7 дней назад
Senior Data Engineer (GCP)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (GCP): Architecting and optimizing scalable data infrastructure and ETL/ELT pipelines on Databricks and BigQuery with an accent on workflow orchestration and data quality enforcement. Focus on designing robust, cost-effective data streaming architectures using Airflow, dbt, and containerization technologies like Kubernetes.
Location: Not specified
Company
is an experience design and technology partner delivering digital products and technology solutions for clients of different sizes.
What you will do
- Define and implement data architecture on GCP, including BigQuery and Databricks warehouses, Google Cloud Storage data lakes, and Data Mart environments.
- Design, build, and optimize batch and real-time ETL/ELT pipelines using Apache Airflow, dbt, Dataflow, Pub/Sub, and BigQuery.
- Develop event-driven and asynchronous workflows between microservices using RabbitMQ, Docker, and Kubernetes.
- Implement Terraform-based infrastructure management and CI/CD pipelines for data engineering components.
- Establish data quality, metadata, lineage, auditing, security, and compliance practices using Great Expectations and related frameworks.
- Collaborate with Data Science, Analytics, and Product teams to support machine learning, reporting, and advanced analytics.
Requirements
- 3+ years of professional data engineering experience, including at least 1 year working with mobile data.
- Strong experience with BigQuery, Google Cloud Storage, Apache Airflow, dbt, Dataflow, Pub/Sub, and Data Mart solutions.
- Strong programming skills in Python, Java, or Scala, plus scripting for automation.
- Experience with Docker, Kubernetes, CI/CD, and DevOps tools such as Terraform, Ansible, Jenkins, or GitLab CI.
- Knowledge of Great Expectations, data lineage, metadata management, GDPR or CCPA compliance, and OLTP/OLAP systems.
- Excellent communication, organization, self-motivation, and problem-solving skills.
Culture & Benefits
- Long-term contract-based collaboration.
- Competitive compensation based on experience and expertise.
- Collaborative and open working environment.
- Flexible collaboration arrangements.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
8 дней назад
Data Platform Engineer, Data Infrastructure & Services (GCP)
9 дней назад
Senior Data Engineer (GCP/BigQuery)
160 000 - 185 000$
9 дней назад
Lead Data Engineer (GCP)
140 000 - 190 000$
Discord
9 дней назад
Senior Data Engineer (Gaming)
220 500 - 245 000$
9 дней назад
Senior Data Engineer (AI)
12 дней назад
Data Engineer (Fintech)
1 040 - 1 280PLN