4 дня назад
Data Engineer - Java (AWS/Spark)
75 - 80$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer - Java (AWS/Spark): Building and maintaining backend data systems and multi-stage AWS pipelines with an accent on Java, Scala, Spark, event-driven architecture, and data quality validation. Focus on configuring and scaling Glue jobs, managing Step Functions state-machine scheduling, handling schema drift and backfills, and synchronizing downstream jobs.
Location: Wilmington, Delaware, with occasional onsite presence in Wilmington, DE, McLean, VA, Richmond, VA, or New York City in a hybrid work environment.
Salary: $75–$80 per hour.
Company
Provides information technology and workforce solutions through a large professional services organization operating across the United States and Canada.
What you will do
- Develop and maintain backend systems using Java, Scala, and Spark.
- Design and implement multi-stage AWS data pipelines with S3, Glue, Step Functions, and Lambda.
- Build event-driven workflows using EventBridge rules and S3 event notifications, including reruns from event-based triggers.
- Configure and scale Glue jobs while addressing Glue 4.0 and Iceberg limitations.
- Develop data validation components for data security, schema drift, and backfill processing.
- Manage state-machine scheduling and downstream job synchronization with Step Functions.
Requirements
- Proven backend development experience with Java, Scala, and Spark.
- Hands-on experience with AWS S3, Glue, Step Functions, and Lambda.
- Strong understanding of event-based architecture and event-driven triggers.
- Experience configuring and scaling Glue jobs.
- Knowledge of data quality validation, schema drift, and backfill handling.
- Ability to work in a hybrid environment with occasional onsite presence at the specified U.S. locations.
Culture & Benefits
- W-2 contract engagement.
- Full-time consultants may receive medical, dental, and vision benefits.
- 401(k) contributions, paid time off, and sick leave are available according to applicable requirements.
- Artificial intelligence tools may assist with application and interview evaluation, while final decisions are made by qualified hiring personnel.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →