Назад
Company hidden
6 дней назад

Senior AWS Python Developer / PySpark Data Engineer (AI)

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior AWS Python Developer / PySpark Data Engineer (AI): Developing scalable Python applications and large-scale data processing solutions on AWS and Spark with an accent on API integration, complex SQL, and big data optimization. Focus on troubleshooting Spark and application performance, automating CI/CD and infrastructure, and processing security-related datasets.

Location: Hybrid in Lafayette, LA; Knoxville, TN; Columbia, SC; or Birmingham, AL, United States.

Company

hirify.global delivers outsourced services and workforce solutions across North America.

What you will do

  • Develop scalable Python applications and data processing solutions for large datasets.
  • Integrate REST APIs with external services and data sources.
  • Write and optimize complex SQL queries and data transformations.
  • Process large datasets using Apache Spark/PySpark and AWS services.
  • Troubleshoot application and data-processing performance.
  • Contribute to CI/CD automation and collaborate with technical and business teams across the organization.

Requirements

  • 8+ years of hands-on Python development experience, including data-intensive and big data applications.
  • Strong Python fundamentals and experience developing scalable, production-grade applications.
  • 5+ years of Apache Spark/PySpark experience, including troubleshooting and optimizing Spark jobs.
  • 5+ years of hands-on AWS development experience with EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.
  • Advanced SQL skills, including complex queries, data transformations, joins, and recursive CTEs.
  • Experience developing and consuming REST APIs and integrating applications with external services and data sources.
  • Strong experience with large datasets, including data manipulation, transformation, analysis, and processing.
  • Experience with big data technologies including Hadoop/EMR, Spark, and Hive.
  • 4+ years of experience with AI-related technologies or applications.
  • Hands-on CI/CD and infrastructure automation experience using GitLab and Terraform.
  • Strong debugging, performance-tuning, analytical, and problem-solving skills.
  • Ability to collaborate effectively across development teams and a matrixed organization.
  • Bachelor’s degree in Computer Science, Information Systems, or a related field.

Culture & Benefits

  • Hybrid work model.
  • Direct-hire employment.
  • Eligible employees may receive medical, dental, vision, spending-account, life-insurance, and voluntary-plan benefits.
  • Participation in a 401(k) plan is available to eligible employees.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →