4 дня назад
Lead Software Engineer (Java/Spark)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Software Engineer (Java/Spark): Owning and modernizing large-scale data flows for batch processing, dataset and index publication, and distributed processing with an accent on Java/Spring integration, Apache Spark workloads, and production orchestration. Focus on designing reliable data-flow architectures, tuning Spark performance, implementing failure recovery and idempotency, and resolving complex production issues.
Location: Dublin, Ohio, United States; hybrid work with three days per week on-site
Company
Mission-driven organization building technology that connects libraries and makes knowledge accessible worldwide through complex datasets, AI and machine learning, and hybrid cloud solutions.
What you will do
- Own and evolve large-scale data flows, including batch processing, transformation, clustering, and publication of datasets and indexes.
- Modernize data-flow architecture by evaluating techniques, patterns, tooling, and build-versus-buy decisions.
- Design batch and distributed-processing solutions with data-quality checks, indexing strategies, replay and idempotency patterns, and Java/Spring service integrations.
- Develop, troubleshoot, profile, and optimize Apache Spark batch workloads.
- Build and maintain Bash-based scripting, orchestration, enterprise scheduling, monitoring, failure handling, and operational runbooks.
- Provide technical leadership through design reviews, standards, mentoring, agile practices, and cross-team roadmap collaboration.
Requirements
- Bachelor's degree in computer science or a related discipline, or equivalent work experience.
- 7+ years of software development experience.
- Professional strength in Java, including shipping, maintaining, and evolving production services.
- Strong Bash scripting experience at scale in production data-flow and batch environments.
- Hands-on Apache Spark experience developing batch workloads and troubleshooting and tuning performance and reliability.
- Experience owning large-scale batch processing and data flows, production job scheduling, dependency chains, failure recovery, operational runbooks, and evolving data schemas.
Culture & Benefits
- Hybrid work environment with on-site collaboration and individual and team workspaces.
- Health coverage, retirement plans with company contributions, paid parental leave, and adoption assistance.
- On-site fitness center, gym facilities, group exercise classes, game room, catering, and subsidized cafeteria.
- Tuition reimbursement and eligibility for Public Service Loan Forgiveness.
- Health and wellness events, plus subsidized local tickets and memberships.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
Lead Software Engineer (Java)
155 700 - 208 700$
4 дня назад
Senior Software Development Engineer (Java)
140 183 - 150 800$
20 часов назад
Lead Software Engineer (Java)
147 118 - 150 600$
4 дня назад
Staff Software Engineer (Flink/Streaming Analytics)
6 дней назад
Lead Software Engineer (Java)
128 470 - 208 770$
4 часа назад