9 часов назад
Senior Software Engineer - Query Engines & Storage
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Software Engineer - Query Engines & Storage (Java/Hadoop/Hive/Trino): Building and operating distributed query engines, data access frameworks, and storage solutions for a customer data platform processing 70B records per day with an accent on scalable data architecture, multi-tenant systems, and production reliability. Focus on automating cluster operations, implementing observability and failure recovery, contributing to open-source projects, and troubleshooting petabyte-scale performance issues.
Location: Tokyo, Japan; hybrid with 3 days per week in the office
Company
develops an agentic experience platform that uses AI to help marketing and data teams acquire, retain, and grow customers.
What you will do
- Design and develop Hadoop, Hive, and Trino query-engine solutions and modern data architectures.
- Establish engineering standards for advanced data access frameworks and distributed systems.
- Define product roadmaps, coordinate feature delivery with Product and Support, and mentor new team members.
- Own version and release management, including baseline evaluation, patch backporting, and customer-facing deployments.
- Partner with SRE to automate cluster lifecycle management, load balancing, observability, capacity planning, and failure recovery.
- Provide expert customer support and on-call troubleshooting while contributing bug fixes, features, documentation, UDFs, and specialized tooling to Hadoop, Hive, and Trino.
Requirements
- 5+ years of experience building and operating distributed systems.
- Strong Java skills and deep knowledge of algorithms, data structures, and distributed-systems fundamentals.
- Solid understanding of public-cloud architecture and services, including AWS, GCP, or Microsoft Azure.
- Experience developing scalable data solutions for multi-tenant environments.
- Experience creating use cases, functional specifications, and design specifications.
- Experience with distributed Big Data stores or NoSQL systems such as HDFS, S3, Cassandra, or Bigtable, plus strong analytical and communication skills.
Nice to have
- Experience with Hadoop, Hive, or Trino, including production query engines at petabyte scale.
- Microservices architecture, data integration patterns, and open-source software extensions.
- Infrastructure as Code, SRE practices, advanced observability, and UDF development.
- Security and privacy by design, data visualization ecosystems, and storage optimization for massively parallel processing.
Culture & Benefits
- Work in a data-driven, customer-focused environment that values initiative, honesty, reliability, openness, and humility.
- Collaborate with Big Data experts across Japan, Korea, and Canada.
- Contribute to open-source projects and help maintain high service quality.
- Inclusive culture focused on diversity, belonging, growth, ownership, and innovation.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
45 минут назад
Global Banking & Markets, FICC E-trading Engineer Vice President (Electronic Trading)
5 дней назад
Platform Software Engineer II (AI)
104 000 - 176 040$
1 день назад
Software Engineer
6 дней назад
Senior C++ Engineer (Fintech)
Databricks
6 дней назад
Staff Designated Support Engineer (Apache Spark)
102 400 - 181 200$
17 часов назад