3 дня назад
Senior Data Engineer (Hadoop)
145 000 - 165 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Hadoop): Building and operating large-scale data processing pipelines and analytics platforms for structured and unstructured data with an accent on Hadoop ecosystem technologies, Spark, streaming platforms, and distributed systems. Focus on ingesting and transforming massive datasets, designing reliable production data platforms, and optimizing performance and cost for analytics, machine learning, and reporting workloads.
Location: 100% remote within the United States
Salary: $145,000–$165,000 annually
Company
is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
What you will do
- Design, build, and operate large-scale data processing pipelines and analytics platforms on Hadoop.
- Ingest, transform, and analyze massive volumes of structured and unstructured data.
- Support enterprise analytics, machine learning, and reporting workloads.
- Develop reliable, performant, and cost-effective production data platforms.
- Troubleshoot, debug, document, and maintain distributed data systems.
Requirements
- Must be based in the United States for this remote position.
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- At least 5 years of professional experience designing and operating Hadoop-based big-data pipelines; 6+ years of overall experience preferred.
- Production experience with Apache Spark using Scala, Python, or Java, plus Hive, HDFS, Sqoop, HBase, and the broader Hadoop ecosystem.
- Experience with Kafka, Spark Streaming, or Flink; strong SQL skills; and experience with relational and NoSQL data stores.
- Experience with Airflow or Oozie, Python or Shell scripting, and distributed systems concepts including partitioning, replication, and fault tolerance.
Nice to have
- Experience running Hadoop on AWS EMR, Azure HDInsight, or Databricks.
- Familiarity with Delta, Iceberg, or Hudi lakehouse formats.
- Experience with Apache Atlas, Collibra, Kubernetes-based data platforms, CI/CD, or infrastructure as code.
Culture & Benefits
- Full-time direct W2 employment.
- Established organization with career growth opportunities.
- Equal employment opportunity across recruitment, employment, compensation, promotion, and other employment decisions.
Hiring process
- Submit a resume for consideration.
- New H-1B visa petitions cannot be sponsored; U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
22 часа назад
Senior Data and Application Engineer (AI)
150 000 - 225 000$
6 дней назад
Senior Data Engineer (Snowflake)
155 000 - 165 000$
21 час назад
Data Engineer (AWS, Azure, GCP)
90 000 - 200 000$
7 дней назад
Lead Data Engineer (Healthcare)
140 000 - 190 000$
4 дня назад
Senior Analytics Engineer (Data)
200 000 - 250 000$
4 дня назад
Data Engineer
174 000 - 230 000$