Big Data Engineer (Hadoop)

TL;DR

Big Data Engineer (Hadoop): Developing and maintaining big data pipelines and infrastructure with an accent on Spark optimization, database performance, and Hadoop ecosystem integration. Focus on building cloud-native applications, managing CI/CD processes, and ensuring data architecture efficiency within an enterprise environment.

Location: Must be based in Charlotte, NC

Salary: $60/hr ($9,600/month)

Company

A professional staffing solutions provider offering contract-based employment opportunities.

What you will do

• Design and maintain data pipelines using Java/Spark or Scala/Spark.
• Manage version control with GIT and streamline development via CI/CD processes.
• Operate within the Hadoop ecosystem utilizing technologies such as Hive and Kafka.
• Optimize SQL queries and Spark performance for large-scale data processing.
• Develop and deploy cloud-native applications on AWS or GCP.
• Perform UNIX bash scripting for system automation and maintenance.

Requirements

• Must be authorized to work on W2 basis only (no C2C)
• Professional experience with Java/Spark or Scala/Spark
• Strong expertise in SQL and database normalization concepts
• Hands-on experience with Hadoop ecosystem and build tools like Gradle or Maven
• Proficiency in UNIX bash scripting
• Visa sponsorship is available

Nice to have

• Experience with S3 and Iceberg data stores
• Data modeling expertise
• Prior experience with cloud deployment on AWS or GCP

Culture & Benefits

• Contract length: 12+ months
• Opportunities for professional growth within a large-scale enterprise environment
• Focus on team accountability and independent ownership of deliverables