TL;DR

Senior Data Engineer: Designing and developing data integration solutions for large data domains with an accent on data/batch processing, manipulation, and ETL. Focus on using Python/PySpark and AWS tools for scalable data infrastructure and performance tuning.

Location: Charlotte, NC, USA. Requires hybrid onsite work.

Salary: $78-80/hr (W2)

Company

%hirify_global% is a company specializing in providing IT staffing services.

What you will do

Design and develop data integration solutions.
Perform data/batch processing, manipulation, mining, and ETL.
Utilize Python/PySpark and AWS tools for data operations.
Work with large data domains and relational databases.

Requirements

Strong data engineering development experience.
Hands-on ETL development using Python and PySpark.
Experience with AWS services (Glue, Lambda, MSK/Kafka, S3, Step Functions, RDS, EKS).
Strong SQL skills, including performance tuning and database objects.
Experience working in Agile/Scrum environments.
Work authorization for W2 employment in the US is required.

Nice to have

Experience with enterprise ETL tools (DataStage, Informatica, Pentaho).
Knowledge of UNIX scripting and Oracle SQL/PL-SQL.
Experience building and consuming REST APIs.
Familiarity with CI/CD and DevOps tools (GitHub, Jenkins).
Knowledge of MDM, data warehousing, and analytics.