Data Engineer II (AWS)

TL;DR

Data Engineer II (AWS): Design, build, test, scale, and maintain data pipelines from diverse sources including internal systems, third-party APIs, and cloud streams with an accent on orchestration, data modeling, and data lake management. Focus on processing large datasets, developing near real-time and batch pipelines, and ensuring production reliability using AWS services and tools like Glue, Airflow, and pySpark.

Fully remote from anywhere, but external candidates may require in-person interview at a hirify.global location such as Orlando, FL.

Company

Independent publicly traded media company with cable networks like USA Network, CNBC, SYFY, Golf Channel, and digital brands like Fandango and Rotten Tomatoes.

What you will do

• Design, build, test, scale, and maintain data pipelines from various sources according to business and technical requirements.
• Improve codebase, participate in agile ceremonies, and oversee team aspects.
• Collaborate with engineers and product managers to understand data needs and participate in standups, retros, and sprint planning.
• Troubleshoot and fix production issues.

Requirements

• Bachelor's degree in Computer Science or related field, or equivalent experience.
• 5+ years in Data Engineering: building data pipelines, orchestration, data modeling, data lake.
• Programming in Python, Java, Scala + SQL for reusable code and automation.
• Experience in data warehousing (relational and dimensional modeling).
• Work with data sources: APIs, real-time feeds, structured/semi-structured files.
• AWS data management: S3, Redshift, DynamoDB, Athena, EMR, Glue, Lambda.
• Processing large datasets with Glue, Airflow/MWAA, SQL, Python, pySpark; near real-time & batch pipelines.
• Agile/Scrum environment.

Nice to have

• Familiar with build, release, deployment, monitoring tools.
• Talend, Informatica, or ETL tools.
• Terraform.
• Strong Test-Driven Development.
• Team-oriented, eager to learn.

Culture & Benefits

• Fueled by innovation and entrepreneurial spirit.
• Empowers creativity, embraces change, drives connection.
• Equal employment opportunities; accommodations for disabilities.
• Competitive compensation based on skills, experience, location; includes health insurance, retirement, paid time off.