Назад
Company hidden
8 часов назад

Data Platform Engineer

100 000 - 150 000$
Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Platform Engineer (Hadoop/Spark): Designing, building, and operating large-scale data processing pipelines and analytics platforms for structured and unstructured data with an accent on Hadoop ecosystem technologies, streaming platforms, and distributed systems. Focus on ingesting and transforming massive data volumes, building reliable production platforms, and optimizing performance and cost for analytics, machine learning, and reporting workloads.

Location: 100% remote within the United States

Salary: $100,000–$150,000 annually

Company

hirify.global is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

What you will do

  • Design, build, and operate large-scale data processing pipelines and analytics platforms.
  • Ingest, transform, and analyze massive volumes of structured and unstructured data.
  • Support enterprise analytics, machine learning, and reporting workloads.
  • Develop streaming data solutions using Kafka, Spark Streaming, or Flink.
  • Operate reliable, performant, and cost-effective production data platforms.
  • Troubleshoot, debug, document, and improve distributed data systems.

Requirements

  • Must be authorized to work in the United States as a U.S. citizen, Green Card holder, EAD holder, or H-1B transfer candidate.
  • New H-1B visa sponsorship is not available for this position.
  • At least 5 years of professional experience designing and operating Hadoop-based big-data pipelines; 6+ years of overall experience preferred.
  • Production expertise with Apache Spark using Scala, Python, or Java, plus Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
  • Experience with Kafka, Spark Streaming, or Flink; strong SQL skills; and experience with relational and NoSQL data stores.
  • Experience with Airflow or Oozie, distributed systems concepts, and Python or Shell scripting.

Nice to have

  • Experience operating Hadoop on AWS EMR, Azure HDInsight, or Databricks.
  • Familiarity with Delta, Iceberg, or Hudi lakehouse formats.
  • Exposure to Apache Atlas or Collibra data governance tooling.
  • Experience with Kubernetes-based data platforms, CI/CD, and infrastructure as code.

Culture & Benefits

  • Full-time direct W-2 employment.
  • 100% remote work within the United States.
  • Opportunity to work on cloud, AI, data, and enterprise solutions.
  • Career growth opportunities within an established consulting and software development organization.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →