4 дня назад
Data Engineer (PySpark)
80 000 - 90 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (PySpark) (Python/Spark/Hadoop): Develop and support distributed data-processing applications with an accent on PySpark development, Hadoop administration, SQL integration, and performance optimization. Focus on designing scalable Spark applications, tuning complex workloads, and working with large datasets across HDFS, HBase, Cassandra, MongoDB, and relational databases.
Location: Tampa, United States
Salary: $80,000–$90,000 base compensation
Company
is a global business and technology transformation partner delivering consulting, engineering, cloud, AI, and data solutions to organizations worldwide.
What you will do
- Monitor and control the full application development lifecycle, including analysis, design, construction, testing, implementation, and operational support.
- Develop and support distributed data-processing applications using Spark and PySpark.
- Analyze complex application and business-process issues and recommend advanced programming solutions.
- Optimize Spark workloads through caching, partitioning, shuffle optimization, and memory management.
- Define operating standards, security measures, and implementation procedures.
- Advise stakeholders and mentor junior analysts while working with limited direct supervision.
Requirements
- 5–8 years of relevant experience in systems analysis and software application development.
- Bachelor’s degree or equivalent experience.
- Expert-level Python and PySpark programming skills, with strong proficiency in Spark Core and Spark SQL.
- In-depth understanding of HDFS, data storage, fault tolerance, YARN, MapReduce, and distributed coordination with ZooKeeper.
- Advanced SQL, including subqueries, window functions, performance tuning, and data integration.
- Experience with dimensional modeling, HBase, Cassandra, MongoDB, RDBMS concepts, Pandas, and NumPy.
Culture & Benefits
- Collaborative environment with colleagues across more than 50 countries.
- Paid time off, company holidays, personal days, and sick leave based on employee grade and local policy.
- Medical, dental, and vision coverage.
- Retirement savings plans, including 401(k) in the United States.
- Life and disability insurance plus employee assistance programs.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
12 часов назад
Data Engineer (Data Science/ML)
80 000 - 90 000$
20 часов назад
Data Engineer (AI)
2 дня назад
Senior Data Engineer (Databricks)
X5
7 дней назад
Data Engineer (Python/Spark)
3 дня назад
Lead Data Engineer (Sr. Palantir Engineer)
150 000 - 180 000$
CIBC
7 дней назад
Lead Databricks Data Engineer (Fintech)
10 000 - 13 333$