Lead Data Engineer

Location: Remote, Bogotá, Colombia

Company

hirify.global is an AI services provider that combines data science, artificial intelligence, technology, and human expertise to deliver data-driven solutions for clients.

What you will do

• Build and maintain scalable ETL pipelines with AWS Glue, Spark, and Athena for modem telemetry, outage events, and customer impact data.
• Develop daily data quality checks using SQL validations, threshold-based alerts, and row-count monitoring.
• Investigate and resolve anomalies such as nulls, duplicates, missing intervals, and unexpected data distributions.
• Integrate data from AOM, IPDR, Scope, CARS, IRIS, and Gisual into unified, validated datasets.
• Certify data products and coordinate versioned releases, including test cases, release notes, go/no-go decisions, and patches.
• Document validation methods and pipeline behavior while collaborating with engineering, BI, and operational stakeholders.

Requirements

• Strong SQL skills, including window functions, grouping sets, null handling, and Athena-specific query patterns.
• Experience with Python for scripting, automation, and data validation.
• Hands-on experience with AWS Glue, Athena, S3, EMR, and Step Functions.
• Experience using Spark for large-scale data processing, preferably on EMR.
• Strong understanding of data quality, pipeline validation, anomaly investigation, and root-cause analysis.
• Strong written communication skills for documenting technical methods and coordinating with stakeholders.

Nice to have

• Experience with telecommunications or network operations data, including modem telemetry, outage records, or IPDR-style feeds.

Culture & Benefits

• Flexible working options.
• AWS, Databricks, and Snowflake certification opportunities.
• AI learning paths, study plans, courses, and access to Udemy Business.
• English lessons, mentorship, and career development plans.
• Company-provided equipment and opportunities to attend industry conferences and meet clients.
• Benefits may vary by location within LATAM.