8 дней назад
Sr. Software Engineer, Data Processing OSS
196 350 - 292 600$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Sr. Software Engineer, Data Processing OSS (C/C++/Java): Advancing DataPelago’s data processing engine through open-source integrations with Apache Gluten, Velox, Apache Spark, and Apache Flink, with an accent on performance, scale, reliability, and hardware-accelerated computing. Focus on architecting engine interfaces, developing high-performance components, optimizing benchmark and customer workloads, and contributing to open-source platforms.
Location: Remote in the United States; San Jose, California
Salary: $196,350–$292,600 per year, with compensation determined by location, qualifications, experience, and education.
Company
develops intelligent data infrastructure, unified storage, integrated data services, and cloud-based solutions for enterprise workloads and AI.
What you will do
- Architect how the DataPelago data processing engine interfaces with open-source platforms and engines.
- Design functional and performance enhancements for Apache Gluten, Velox, and related platforms.
- Design, implement, test, optimize, and maintain core data processing engine components.
- Analyze open-source technology roadmaps and identify opportunities for product differentiation.
- Collaborate with engineering, product management, open-source communities, and customer success teams.
- Improve design reviews, code reviews, testing, CI/CD, issue resolution, security, and product quality.
Requirements
- 12+ years of relevant experience and a bachelor's degree in Computer Science or a related field, or a master's degree in Computer Science.
- 3+ years of deep technical experience developing core components of large-scale data processing platforms such as Apache Spark, Apache Flink, Apache Doris, Apache Gluten, Velox, Apache DataFusion, or equivalent systems.
- 3+ years of experience instrumenting, analyzing, and optimizing data processing engine performance on benchmark and customer workloads.
- Strong knowledge of the architecture and internal operation of Apache Spark, Apache Flink, or Presto/Trino.
- Experience designing, developing, and releasing high-performance data processing engines for large production deployments.
- Exceptional programming skills in C, C++, and Java, plus extensive Linux development experience.
Culture & Benefits
- Remote work is available for the United States, with some in-office or in-person expectations communicated during the recruitment process.
- Benefits may include health insurance, life insurance, retirement or pension plans, paid time off, leave options, performance-based incentives, employee stock purchase plans, and restricted stock units.
- Work with open-source communities and engineering teams advancing parallel processing, query optimization, distributed systems, compilers, machine learning, and cloud-native computing.
- Equal employment opportunity and a culture that values initiative, ownership, diverse perspectives, and problem solving.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
13 дней назад
Staff Software Engineer (Distributed Storage)
200 000 - 250 000$
12 дней назад
Backend Engineer (Big Data)
156 500 - 235 000$
12 дней назад
Sr. SW AI Engineer (Java)
110 700 - 171 800$
13 дней назад
Senior Software Engineer
155 700 - 173 000$
11 дней назад
Staff Engineer (Backend)
260 000 - 306 000$
7 дней назад
Senior Software Engineer
190 100 - 285 100$