Назад
Company hidden
4 дня назад

Data Engineer (PySpark)

80 000 - 90 000$
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Engineer (PySpark) (Python/Spark/Hadoop): Develop and support distributed data-processing applications with an accent on PySpark development, Hadoop administration, SQL integration, and performance optimization. Focus on designing scalable Spark applications, tuning complex workloads, and working with large datasets across HDFS, HBase, Cassandra, MongoDB, and relational databases.

Location: Tampa, United States

Salary: $80,000–$90,000 base compensation

Company

hirify.global is a global business and technology transformation partner delivering consulting, engineering, cloud, AI, and data solutions to organizations worldwide.

What you will do

  • Monitor and control the full application development lifecycle, including analysis, design, construction, testing, implementation, and operational support.
  • Develop and support distributed data-processing applications using Spark and PySpark.
  • Analyze complex application and business-process issues and recommend advanced programming solutions.
  • Optimize Spark workloads through caching, partitioning, shuffle optimization, and memory management.
  • Define operating standards, security measures, and implementation procedures.
  • Advise stakeholders and mentor junior analysts while working with limited direct supervision.

Requirements

  • 5–8 years of relevant experience in systems analysis and software application development.
  • Bachelor’s degree or equivalent experience.
  • Expert-level Python and PySpark programming skills, with strong proficiency in Spark Core and Spark SQL.
  • In-depth understanding of HDFS, data storage, fault tolerance, YARN, MapReduce, and distributed coordination with ZooKeeper.
  • Advanced SQL, including subqueries, window functions, performance tuning, and data integration.
  • Experience with dimensional modeling, HBase, Cassandra, MongoDB, RDBMS concepts, Pandas, and NumPy.

Culture & Benefits

  • Collaborative environment with colleagues across more than 50 countries.
  • Paid time off, company holidays, personal days, and sick leave based on employee grade and local policy.
  • Medical, dental, and vision coverage.
  • Retirement savings plans, including 401(k) in the United States.
  • Life and disability insurance plus employee assistance programs.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →