Lead Big Data Engineer (AWS)

Location: Remote, Chile; includes a three-month business trip to the United States in Q1 2027

Company

hirify.global provides engineering and technology services, including cloud-based data platform development and support.

What you will do

• Support, maintain, and enhance an AWS-based data platform and data ingestion pipelines.
• Develop and optimize large-scale data processing workflows with Python, PySpark, Apache Spark, and AWS Glue.
• Monitor and troubleshoot pipelines to ensure reliability, performance, and data quality.
• Work with AWS services including S3, Aurora PostgreSQL, Athena, Lambda, SQS, SNS, and EventBridge.
• Maintain workflow orchestration with Apache Airflow and support infrastructure and deployments with Docker, Terraform, and Amazon EKS.
• Apply automated testing, code quality checks, CI/CD, AI-assisted development tools, and data security, governance, and compliance practices.

Requirements

• 5+ years of experience in Big Data or Data Engineering, including supporting production data platforms.
• Strong proficiency in Python, PySpark, and Apache Spark for large-scale data processing.
• Hands-on experience with AWS Glue, S3, Athena, Aurora PostgreSQL, and Lambda.
• Experience with Apache Airflow for data pipeline orchestration and scheduling.
• Strong knowledge of SQL, data ingestion, ETL processes, and data quality practices.
• Experience with Docker, Terraform, and CI/CD pipelines using GitHub Actions or similar tools.
• Familiarity with pytest, Pydantic, ruff, or mypy.
• Readiness to travel to the United States for a three-month business trip in Q1 2027.
• Upper-intermediate or higher English level, with strong communication and problem-solving skills.

Nice to have

• Understanding of healthcare data regulations such as HIPAA/HITRUST, multi-tenant architectures, or data retention requirements.

Culture & Benefits

• Remote work from Chile.
• Collaboration with a distributed engineering team.
• Work with healthcare data in a regulated environment.
• Three-month business trip to the United States in Q1 2027.