Data Engineer (GCP)

TL;DR

Data Engineer (GCP): Responsible for data preparation for Data Science teams, including reviewing sources, cleaning, integration, and transformation, along with creating data ingestion processes for models to generate predictions with an accent on ETL and Pipelines. Focus on using SQL and Python for machine learning tasks, managing APIs, and working with cloud services like GCP.

Location: Colombia

Company

hirify.global is a Digital accelerator that helps companies enter the future, having 20 years of experience as Digital Partners of some of the largest companies in the world.

What you will do

• Perform SQL scripting for ETL processes and complex database tasks.
• Implement Python for ETLs and pipelines related to machine learning.
• Use GCP for tagging data sets and transformations for different model types.
• Create data ingestion processes to generate predictions for models.
• Manage APIs and Azure Pipelines, including Log Analytics, Azure Functions, and Databricks.

Requirements

• 3+ years of experience with SQL (ETL, Complex Database Scripting).
• 3+ years of experience with Python (ETLs, Pipelines) for Machine Learning.
• 2+ years of experience with GCP.
• Experience in data preparation for Data Science teams, including review of sources, cleaning, integration, and data transformation.
• Experience in creating data ingestion processes to models.
• Familiarity with GIT, CI/CD, Spark, Hadoop, and NoSQL databases.

Culture & Benefits

• Professional growth opportunities.
• Dynamic work environment.
• Attractive benefits plan.
• Legal and superior benefits.