Big Data Architect

TL;DR

Big Data Architect: Designing and supporting large-scale data ingestion pipelines within Hadoop ecosystems with an accent on data validation, enrichment, and distribution to SQL and downstream applications. Focus on building robust architectures for massive datasets using Python, Spark, and the Hadoop ecosystem.

Location: Must be based in Hillsboro, OR

Company

A global staffing, consulting, and technology solutions company serving Fortune 500 clients and worldwide corporations.

What you will do

• Design and support ingestion pipelines for large-scale data sets into Hadoop ecosystems.
• Validate and enrich data to ensure high quality for downstream consumption.
• Distribute significant volumes of data to SQL databases and various enterprise applications.
• Collaborate on maintaining and optimizing large-scale Hadoop environments.

Requirements

• Location: Must be based in Hillsboro, OR
• Hands-on experience with Python and Spark.
• At least 2 years of experience in the Big Data ecosystem including HDFS, MapReduce, Hive, and HBase.
• Proven experience working with large-scale Hadoop environments and massive data sets.
• Graduate degree or equivalent qualification.