обновлено 52 минуты назад
Hadoop Big Data Developer
86 000 - 103 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Hadoop Big Data Developer (Hadoop/Apache Spark): Building and operating large-scale data processing pipelines and analytics platforms for structured and unstructured data with an accent on distributed data processing, streaming, and production reliability. Focus on ingesting and transforming massive datasets, designing fault-tolerant architectures, and supporting enterprise analytics, machine learning, and reporting workloads.
Location: 100% remote within the United States
Salary: $86,000–$103,000 annually
Company
is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
What you will do
- Design, build, and operate large-scale data processing pipelines on Hadoop and related big-data platforms.
- Ingest, transform, and analyze massive volumes of structured and unstructured data.
- Develop production workloads supporting enterprise analytics, machine learning, and reporting.
- Build streaming data solutions using platforms such as Kafka, Spark Streaming, or Flink.
- Implement workflow orchestration with tools such as Airflow or Oozie.
- Troubleshoot, debug, document, and optimize data platforms for reliability, performance, and cost efficiency.
Requirements
- 5+ years of professional experience designing and operating big-data pipelines on Hadoop; the posting indicates 6+ years of overall experience.
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- Strong production experience with Apache Spark using Scala, Python, or Java.
- Hands-on expertise with Hive, HDFS, Sqoop, HBase, SQL, relational databases, and NoSQL data stores.
- Understanding of distributed systems concepts, including partitioning, replication, and fault tolerance.
- Applicants must be eligible to work in the United States as U.S. citizens, Green Card holders, EAD holders, or H-1B transfer candidates. New H-1B visa petitions cannot be sponsored.
Nice to have
- Experience running Hadoop on AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with Delta, Iceberg, or Hudi lakehouse formats.
- Exposure to Apache Atlas or Collibra data governance tooling.
- Experience with Kubernetes-based data platforms, including Spark-on-Kubernetes or Trino.
- Experience with CI/CD and infrastructure-as-code for data engineering workflows.
Culture & Benefits
- Full-time direct W-2 employment.
- Remote work arrangement within the United States.
- Career growth opportunities within an established technology organization.
- Equal employment opportunity and a workplace free from discrimination and harassment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Rubytech
6 дней назад
Data Analyst (Big Data, ETL, Python, SQL)
5 дней назад
Senior Data Analyst (AI/ML)
230 000 - 250 000$
3 дня назад
Data Quality Analyst (AI)
80 000 - 95 000$
5 часов назад
Educational Data Analyst
110 000 - 120 000$
7 часов назад
Infrastructure & Capital Projects – Data Analyst III, ANS (AWS)
105 000 - 115 000$
Jetlyn
6 дней назад