4 часа назад
Senior Data Engineer (PySpark)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (PySpark): Building and modernizing large-scale cloud data platforms, pipelines, and lakehouse solutions with an accent on Spark-based processing, Cloudera, Apache Iceberg, and Airflow. Focus on designing scalable ETL/ELT workflows, optimizing structured and unstructured data processing, and supporting enterprise cloud migration programs.
Location: 100% remote within the United States
Company
is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.
What you will do
- Build and maintain large-scale data pipelines and Spark-based data processing solutions.
- Develop data workflows on Cloudera Data Platform using Apache Airflow.
- Design and manage Apache Iceberg tables, data lakes, and lakehouse architectures.
- Implement ETL/ELT processes for structured and unstructured datasets.
- Support enterprise cloud migration and modernization initiatives.
- Apply data modeling, performance tuning, troubleshooting, and DevOps practices.
Requirements
- Must be located in the United States and authorized to work there.
- Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
- 10+ years of IT experience, including 6+ years in data engineering and big data development.
- Strong hands-on experience with PySpark, Spark, Cloudera Data Platform, Apache Iceberg, Apache Airflow, SQL, and data modeling.
- Experience with ETL/ELT development, Git, CI/CD pipelines, DevOps practices, and large-scale datasets.
- Strong analytical, troubleshooting, communication, and collaboration skills.
Nice to have
- AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch.
- Cloud-native data lake and lakehouse development, data partitioning, query optimization, and performance tuning.
- Kafka, event-driven processing, Java or Python application development, and data governance solutions.
- Healthcare, Medicaid, claims processing, or insurance industry experience.
- Agile delivery experience and AWS or Cloudera certification.
Culture & Benefits
- Contracted position with an established technology consulting and software development organization.
- Opportunity to work on enterprise cloud, AI, data, and modernization programs.
- Career growth potential within a well-established organization.
- Equal employment opportunity workplace.
Hiring process
- Submit a resume for consideration.
- U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply.
- New H-1B visa petitions cannot be sponsored for this position.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →