6 дней назад
Hadoop Big Data Developer
100 000 - 150 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Hadoop Big Data Developer (Hadoop/Apache Spark): Designing, building, and operating large-scale data processing pipelines and analytics platforms for structured and unstructured data with an accent on distributed processing, streaming, and production reliability. Focus on ingesting and transforming massive datasets, optimizing fault-tolerant platforms, and supporting enterprise analytics, machine learning, and reporting workloads.
Location: 100% remote within the United States
Salary: $100,000–$150,000 annually
Company
is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
What you will do
- Design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related ecosystems.
- Ingest, transform, and analyze massive volumes of structured and unstructured data.
- Develop production workloads supporting enterprise analytics, machine learning, and reporting.
- Use Apache Spark and streaming platforms to deliver reliable and performant data processing.
- Troubleshoot, debug, document, and improve cost-effective distributed data platforms.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- 10+ years of professional experience designing and operating Hadoop big-data pipelines.
- Strong production experience with Apache Spark using Scala, Python, or Java.
- Hands-on expertise with Hive, HDFS, Sqoop, HBase, Kafka, Spark Streaming, or Flink.
- Strong SQL, Python or Shell scripting, and experience with relational and NoSQL data stores.
- Experience with Airflow or Oozie and distributed-systems concepts including partitioning, replication, and fault tolerance.
Nice to have
- Experience running Hadoop on AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with Delta, Iceberg, or Hudi lakehouse formats.
- Exposure to Apache Atlas, Collibra, Kubernetes-based data platforms, CI/CD, or infrastructure as code.
Culture & Benefits
- Full-time direct W-2 employment.
- Remote work within the United States.
- Career growth opportunities within an established consulting and software development organization.
Hiring process
- Submit a resume for consideration.
- New H-1B visa petitions cannot be sponsored; U.S. citizens, Green Card holders, EAD holders, and H-1B transfer candidates are encouraged to apply.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Senior Software Engineer-Bigdata & Hadoop Engineer with Development Experience
110 700 - 171 800$
13 дней назад
Senior Engineer, IT (Data Engineering)
157 414 - 162 125$
Top Selection
7 дней назад
Data Engineer (MLOps)
280 000 - 300 000₽
10 дней назад
Senior/Lead Big Data Engineer (Databricks + GCP)
12 дней назад
Senior Data Engineer (Healthcare)
145 000 - 175 000$
12 дней назад
Senior Data Engineer (Analytics)
170 000 - 200 000$