Эта вакансия в архиве
Посмотреть похожие вакансии ↓обновлено 2 месяца назад
Senior Big Data Engineer (GCP)
198 440$
Описание вакансии
Текст:
TL;DR
Senior Big Data Engineer (GCP): Designing and developing scalable batch processing systems and large-scale data pipelines using Hadoop ecosystem tools with an accent on Oozie orchestration, Pig, and cloud-native solutions on Google Cloud Platform. Focus on building robust data workflows, leading Jira Epics, and implementing DevOps best practices for CI/CD and infrastructure automation.
Location: Remote in United States or Canada
Salary: $135,300 - $198,440
Company
is a multicloud solutions expert delivering end-to-end technology solutions across applications, data, and security, recognized as a best place to work by Fortune, Forbes, and Glassdoor.
What you will do
- Design and develop scalable batch processing systems using Hadoop, Oozie, Pig, Hive, MapReduce, and HBase with Java or Python coding.
- Lead Jira Epics and manage complex data workflows within the Apache Hadoop ecosystem.
- Leverage Google Cloud Platform tools like Dataproc, GCS, and Composer for cloud-native big data solutions.
- Implement DevOps and automation best practices including CI/CD pipelines and Infrastructure as Code.
- Collaborate with cross-functional teams to ensure data pipeline reliability and operational excellence in a remote-first environment.
Requirements
- Must be located in the United States or Canada for this remote role.
- 5+ years of experience in customer-facing software/technology or consulting.
- 5+ years of experience with on-premises to cloud migrations or IT transformations.
- Proficiency in Oozie, Pig, Java (Spark), Python, and SQL.
- Strong expertise in the Apache Hadoop ecosystem and Google Cloud Platform.
- Experience with DevOps practices, CI/CD, and Infrastructure as Code tools like Terraform.
Nice to have
- Experience with BigTable and Redis.
- Experience leading Jira Epics.
Culture & Benefits
- Remote-first work environment supporting US and Canada locations.
- Recognized as a best place to work by multiple industry sources.
- Commitment to diversity, equity, and inclusion.
- Use of AI tools to support hiring process while maintaining human decision-making.