Senior Data Engineer (GCP)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (GCP): Architecting and optimizing scalable data infrastructure and ETL/ELT pipelines on Databricks and BigQuery with an accent on workflow orchestration and data quality enforcement. Focus on designing robust, cost-effective data streaming architectures using Airflow, dbt, and containerization technologies like Kubernetes.
Location: Office work in Poland or remote within Poland
Company
is a design and technology partner delivering industry-leading digital experiences.
What you will do
- Define and implement GCP-based data architecture, including data lakes and Data Mart environments.
- Design and optimize complex ETL/ELT pipelines using Apache Airflow and dbt.
- Implement real-time and batch data processing using Dataflow and Pub/Sub.
- Manage infrastructure-as-code using Terraform and implement CI/CD for data components.
- Ensure data quality, lineage, and security compliance with frameworks like Great Expectations.
- Collaborate with Data Science and Product teams to support advanced analytics initiatives.
Requirements
- 3+ years of professional data engineering experience, including 1+ year in mobile data.
- Proven track record with BigQuery, Google Cloud Storage, and GCP data ecosystems.
- Deep knowledge of Apache Airflow, dbt, and streaming technologies like Pub/Sub/Dataflow.
- Strong proficiency in Python, Java, or Scala with experience in Docker and Kubernetes.
- Experience with IaC tools like Terraform and DevOps CI/CD practices.
- Strong understanding of data quality, lineage, and GDPR/CCPA compliance.
Culture & Benefits
- Competitive compensation package.
- Private medical care and health insurance.
- 21 working days of paid vacation plus Polish national holidays.
- Compensation for sick leave.
- Opportunities for professional learning and development.
- Friendly work environment with team events.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →