Data Engineer (GCP / DataOps)

TL;DR

Data Engineer (GCP / DataOps): Designing and optimizing data pipelines and serverless architectures within the Google Cloud Platform with an accent on automation, observability, and cost optimization. Focus on building robust DAGs in Airflow, transforming data with dbt, and implementing CI/CD pipelines via Azure DevOps.

Location: Hybrid in Madrid, Spain

Company

hirify.global is a leading technology services company focusing on mission-critical systems and AI-powered insights for global businesses.

What you will do

• Configure data lifecycles from development to production using Azure DevOps for automatic deployment to GCP.
• Program and supervise efficient workflows in Cloud Composer (Apache Airflow) with intelligent retry handling.
• Write and maintain business logic in SQL using dbt, executing transformations on BigQuery for maximum performance.
• Implement serverless ingests using Cloud Functions (event-driven) and orchestrate containers in Cloud Run.
• Design technical monitoring dashboards in Looker to track pipeline status, data latency, and SLA compliance.
• Optimize BigQuery costs and performance by analyzing job history and improving table structures.

Requirements

• Expertise in Apache Airflow, including complex DAG design and custom operators.
• Strong proficiency in dbt (data build tool) for transformation, quality testing, and version control.
• Experience with GCP serverless tools, specifically Cloud Run and Cloud Functions.
• Deep knowledge of BigQuery, including partitioning, clustering, and query optimization.
• Experience configuring YAML pipelines in Azure DevOps for CI/CD of dbt and Airflow.
• Ability to build observability dashboards in Looker.

Culture & Benefits

• Hybrid-friendly work culture prioritizing employee well-being.
• "Be Well" programs supporting financial, mental, physical, and social health.
• Access to professional certifications from Google, Microsoft, and Amazon.
• Inclusive environment valuing empathy and shared success.
• Personalized development goals and continuous feedback mechanisms.