Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (AI/AWS): Implementing and operationalizing AI and LLM-based tooling to automate data engineering workflows with an accent on building automated frameworks for data ingestion, transformation, and orchestration. Focus on integrating AI/ML capabilities into pipelines for anomaly detection, metadata enrichment, and pattern recognition.

Location: Heredia, Costa Rica

Company

A global data and technology company listed on the FTSE 100, specializing in redefining lending practices, fraud prevention, and providing data-driven insights across financial, healthcare, and automotive markets.

What you will do

• Lead the implementation of AI and LLM-based tooling to automate data engineering workflows, including code generation and schema drift detection.
• Build automated frameworks for data ingestion, transformation, orchestration, and deployment using AI-powered accelerators.
• Integrate AI/ML capabilities into pipelines for anomaly detection, metadata enrichment, and pattern recognition.
• Develop and operationalize data quality monitoring systems.

Requirements

• Bachelor’s degree in Computer Science or equivalent experience.
• 10+ years of experience in commercial software development environments.
• Expert-level proficiency in PySpark, Python, and SQL.
• Extensive experience with AWS services, including API Gateway, Lambda, EC2, ECS, SQS, SNS, DynamoDB, Redshift, and Aurora.

Culture & Benefits

• Award-winning "people first" culture, recognized as one of the World's Best Workplaces 2024 by Fortune.
• Strong focus on DEI, authenticity, collaboration, and work/life balance.
• Emphasis on employee development, wellness, and reward & recognition.
• Inclusive environment that supports diverse backgrounds and provides necessary accommodations for disabilities.