обновлено 5 дней назад
Big Data Application Developer (Hadoop)
100 000 - 150 000$
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Big Data Application Developer (Hadoop): Building and operating large-scale data processing pipelines and analytics platforms for enterprise analytics, machine learning, and reporting workloads with an accent on Hadoop, Spark, streaming platforms, and distributed data systems. Focus on ingesting and transforming massive data volumes, designing fault-tolerant architectures, and optimizing production platforms for reliability, performance, and cost.
Location: 100% remote within the United States
Salary: $100,000–$150,000 annually
Company
is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
What you will do
- Design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop and related ecosystems.
- Ingest, transform, and analyze structured and unstructured data for enterprise analytics, machine learning, and reporting workloads.
- Develop reliable, performant, and cost-effective production data platforms.
- Work with distributed systems, streaming data platforms, workflow orchestration, and relational and NoSQL data stores.
- Troubleshoot, debug, document, and support data engineering solutions.
Requirements
- 5+ years of professional experience designing and operating big-data pipelines on Hadoop; the posting specifies 6+ years of overall experience.
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- Strong production experience with Apache Spark using Scala, Python, or Java.
- Experience with Hive, HDFS, Sqoop, HBase, Kafka, Spark Streaming, Flink, SQL, Airflow, or Oozie.
- Understanding of distributed systems concepts including partitioning, replication, and fault tolerance, plus strong Python or Shell scripting skills.
- Applicants must be eligible to work in the United States; U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply.
Nice to have
- Experience with Hadoop on AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with Delta, Iceberg, or Hudi lakehouse formats.
- Experience with Apache Atlas, Collibra, Kubernetes-based data platforms, CI/CD, or infrastructure as code.
Culture & Benefits
- Full-time direct W-2 employment.
- Remote work within the United States.
- Career growth opportunities within an established technology consulting and software development organization.
- Equal employment opportunity and a workplace free from harassment and discrimination.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Музыка
Осень
Поддержка