8 часов назад
Data Platform Engineer
100 000 - 150 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Platform Engineer (Hadoop/Spark): Designing, building, and operating large-scale data processing pipelines and analytics platforms for structured and unstructured data with an accent on Hadoop ecosystem technologies, streaming platforms, and distributed systems. Focus on ingesting and transforming massive data volumes, building reliable production platforms, and optimizing performance and cost for analytics, machine learning, and reporting workloads.
Location: 100% remote within the United States
Salary: $100,000–$150,000 annually
Company
is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
What you will do
- Design, build, and operate large-scale data processing pipelines and analytics platforms.
- Ingest, transform, and analyze massive volumes of structured and unstructured data.
- Support enterprise analytics, machine learning, and reporting workloads.
- Develop streaming data solutions using Kafka, Spark Streaming, or Flink.
- Operate reliable, performant, and cost-effective production data platforms.
- Troubleshoot, debug, document, and improve distributed data systems.
Requirements
- Must be authorized to work in the United States as a U.S. citizen, Green Card holder, EAD holder, or H-1B transfer candidate.
- New H-1B visa sponsorship is not available for this position.
- At least 5 years of professional experience designing and operating Hadoop-based big-data pipelines; 6+ years of overall experience preferred.
- Production expertise with Apache Spark using Scala, Python, or Java, plus Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
- Experience with Kafka, Spark Streaming, or Flink; strong SQL skills; and experience with relational and NoSQL data stores.
- Experience with Airflow or Oozie, distributed systems concepts, and Python or Shell scripting.
Nice to have
- Experience operating Hadoop on AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with Delta, Iceberg, or Hudi lakehouse formats.
- Exposure to Apache Atlas or Collibra data governance tooling.
- Experience with Kubernetes-based data platforms, CI/CD, and infrastructure as code.
Culture & Benefits
- Full-time direct W-2 employment.
- 100% remote work within the United States.
- Opportunity to work on cloud, AI, data, and enterprise solutions.
- Career growth opportunities within an established consulting and software development organization.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Datadog
6 часов назад
Senior Data Engineer - Revenue Data Platform
192 000 - 240 000$
2 дня назад
Data Engineer I (Space)
80 000 - 115 000$
24 часа назад
Data Engineer
174 000 - 230 000$
3 дня назад
Senior Data Engineer (Snowflake)
155 000 - 165 000$
4 дня назад
Lead Data Engineer (Healthcare)
140 000 - 190 000$
7 дней назад
Senior Data Engineer (Databricks)
140 000 - 160 000$