Data Engineer

TL;DR

Data Engineer (ETL/Big Data): Building and optimizing data pipelines, ETL processes, and storage solutions using cloud platforms and big data technologies with an accent on performance tuning, automation, and scalability. Focus on handling Parquet files in S3, integrating Spark, Hadoop, Kafka, and collaborating on complex initiatives in Agile environments.

Hybrid in Charlotte, NC

Company

hirify.global is a staffing firm providing contingent workforce for IT and software engineering projects.

What you will do

• Consult on complex data engineering initiatives with broad impact and large-scale planning.
• Review and analyze multi-faceted software engineering challenges requiring in-depth evaluation.
• Contribute to resolving complex situations involving data pipelines, performance tuning, and compliance.
• Strategically collaborate with client personnel on ETL, big data processing, and automation.
• Participate in Agile processes including backlog grooming, sprint planning, and stand-ups.

Requirements

• 5+ years of software engineering experience or equivalent.
• Data engineering experience with proficiency in databases, SQL, PL/SQL.
• Experience with Python or Java, ETL tools, data pipeline frameworks.
• Work with Parquet files in S3 buckets, relational and NoSQL databases.
• Familiarity with big data technologies: Apache Spark, Hadoop, Kafka.
• Hands-on performance tuning, report automations, Agile methodology.
• Experience with cloud platforms: AWS, GCP, Azure.

Nice to have

• Experience with Artificial Intelligence.