Big Data Developer (Spark)

TL;DR

Big Data Developer (Spark): Developing and optimizing large-scale data processing solutions with an accent on Spark and Hadoop cluster performance tuning. Focus on building robust data pipelines using Scala, Java, and SQL to ensure high system efficiency and reliability.

Location: Must be based in Cupertino, CA

Company

A global staffing, consulting, and technology solutions company serving Fortune 500 clients and worldwide corporations.

What you will do

• Develop and maintain high-performance data processing applications using Spark and Scala.
• Perform in-depth tuning of Spark and Hadoop clusters to optimize system performance.
• Write and optimize complex SQL queries for data analysis and transformation.
• Collaborate with cross-functional teams to solve complex data engineering challenges.
• Utilize Unix environments for system management and script execution.

Requirements

• 10-12 years of professional experience in Big Data development.
• In-depth expertise in Spark performance tuning and Hadoop cluster tuning.
• Strong proficiency in Java and Scala.
• Experience with Spark SQL and general SQL coding.
• Bachelor's or Master's degree in Engineering (BE/B-Tech/M-Tech).
• Excellent analytical, problem-solving, and communication skills.

Hiring process

• Phone interview.
• Skype interview.