обновлено 2 дня назад
Data Engineer (AWS/PySpark)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AWS/PySpark): Developing and supporting ETL and data transformation jobs for a global data warehouse with an accent on PySpark, IBM DataStage, SQL, and AWS. Focus on optimizing data pipelines, troubleshooting production issues, performing root cause analysis, and coordinating integration testing and production migrations.
Location: Bangalore, Karnataka, India
Company
is a healthcare company focused on improving healthcare delivery and its mission to save and sustain lives.
What you will do
- Develop new ETL and data transformation jobs using PySpark and IBM DataStage in AWS.
- Enhance, support, monitor, and troubleshoot existing ETL jobs for a global data warehouse.
- Perform code reviews, integration testing, and production migration support.
- Investigate production incidents through root cause analysis, performance tuning, reject handling, and ad-hoc reloads.
- Translate business communications into technical specifications, source-to-target mappings, and data dependency documentation.
- Communicate technical solutions and resolutions with internal customers and coordinate incident follow-up.
Requirements
- 5+ years of ETL and SQL experience.
- 3+ years of Python and PySpark experience, including debugging and writing PySpark code.
- 3+ years of AWS and UNIX experience, including basic shell scripting in Bash or KornShell.
- 2+ years of IBM DataStage experience.
- Strong SQL fundamentals, including subqueries and query performance tuning.
- Bachelor of Science in Computer Science or equivalent experience.
Nice to have
- Snowflake experience or certification.
- AWS Certified Cloud Practitioner, Certified DataStage Professional, Python or PySpark certifications, SnowPro Certification, DE with AI Certification, or Control-M Scheduler Certification.
Culture & Benefits
- Work in a culture centered on courage, trust, collaboration, ownership, and accountability.
- Collaborate with internal customers and technical professionals in global, cross-functional environments.
- Reasonable accommodations are available for candidates with disabilities during the application and interview process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →