Data Engineer (GCP)
ΠΡΡΡ & Π‘ΠΎΠΏΡΠΎΠ²ΠΎΠ΄
ΠΠ»Ρ ΠΌΡΡΡΠ° Ρ ΡΡΠΎΠΉ Π²Π°ΠΊΠ°Π½ΡΠΈΠ΅ΠΉ Π½ΡΠΆΠ΅Π½ Plus
ΠΠΏΠΈΡΠ°Π½ΠΈΠ΅ Π²Π°ΠΊΠ°Π½ΡΠΈΠΈ
TL;DR
Data Engineer (GCP): Building and maintaining scalable data pipelines on Google Cloud Platform with an accent on orchestration, database optimization, and infrastructure as code. Focus on developing robust ETL processes using Airflow and BigQuery, ensuring high-quality deployments via Terraform, and collaborating with architects to deliver efficient data solutions.
Location: Remote (Portugal)
Company
is a technology consulting firm providing specialized engineering and digital transformation services.
What you will do
- Develop and maintain data pipelines based on defined architectural requirements.
- Deploy infrastructure using Terraform and ensure adherence to industry best practices.
- Collaborate with Data Architects and Project Managers to translate business needs into technical solutions.
- Perform code reviews and maintain high standards of codebase quality.
- Define and execute testing strategies for pipelines to ensure functional and technical accuracy.
- Monitor deployments and manage error tracking to ensure system reliability.
Requirements
- Must be based in Portugal
- Minimum 1 year of experience with Google Cloud Platform (GCP).
- At least 2 years of experience with Apache Airflow.
- Extensive experience (2+ years) with Google BigQuery, including table and query optimization.
- At least 1 year of experience with Terraform.
- Strong communication skills for technical and project-level collaboration.
Nice to have
- Experience with Apache Spark and PySpark.
- Knowledge of Azure Cloud Platform.
- Experience with Google Composer, Pub/Sub, Kafka, or Dataflow/Apache Beam.
Culture & Benefits
- Opportunity to work on diverse projects within a professional consulting environment.
- Focus on standardized industry practices and architectural patterns.
- Collaborative team culture with regular peer reviews and knowledge sharing.
ΠΡΠ΄ΡΡΠ΅ ΠΎΡΡΠΎΡΠΎΠΆΠ½Ρ: Π΅ΡΠ»ΠΈ ΡΠ°Π±ΠΎΡΠΎΠ΄Π°ΡΠ΅Π»Ρ ΠΏΡΠΎΡΠΈΡ Π²ΠΎΠΉΡΠΈ Π² ΠΈΡ ΡΠΈΡΡΠ΅ΠΌΡ, ΠΈΡΠΏΠΎΠ»ΡΠ·ΡΡ iCloud/Google, ΠΏΡΠΈΡΠ»Π°ΡΡ ΠΊΠΎΠ΄/ΠΏΠ°ΡΠΎΠ»Ρ, Π·Π°ΠΏΡΡΡΠΈΡΡ ΠΊΠΎΠ΄/ΠΠ, Π½Π΅ Π΄Π΅Π»Π°ΠΉΡΠ΅ ΡΡΠΎΠ³ΠΎ - ΡΡΠΎ ΠΌΠΎΡΠ΅Π½Π½ΠΈΠΊΠΈ. ΠΠ±ΡΠ·Π°ΡΠ΅Π»ΡΠ½ΠΎ ΠΆΠΌΠΈΡΠ΅ "ΠΠΎΠΆΠ°Π»ΠΎΠ²Π°ΡΡΡΡ" ΠΈΠ»ΠΈ ΠΏΠΈΡΠΈΡΠ΅ Π² ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠΊΡ. ΠΠΎΠ΄ΡΠΎΠ±Π½Π΅Π΅ Π² Π³Π°ΠΉΠ΄Π΅ β