22 часа назад
Senior Engineer - Hyperscale Analytics
237 800 - 441 500$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Engineer - Hyperscale Analytics (Distributed Data Systems): Building and scaling data processing and analytics platforms for OLTP, OLAP, and AI-driven decisioning with an accent on distributed pipelines, cloud-scale data architecture, and petabyte-scale performance. Focus on designing low-latency, high-throughput systems, integrating lakehouse and warehouse technologies, and ensuring reliability and observability across large compute and storage clusters.
Location: San Jose, CA; hybrid work
Compensation: $237,800–$441,500 USD annually in total target compensation
Company
develops data resilience and data security solutions that help organizations secure, understand, and protect data and AI systems.
What you will do
- Design and implement scalable OLTP systems for real-time workloads and OLAP systems for complex analytical queries.
- Build, optimize, and maintain large-scale batch and streaming pipelines using Spark, Flink, Presto/Trino, or Kafka Streams.
- Optimize low-latency queries, high-throughput ingestion, and interactive analytics at petabyte scale.
- Develop and integrate storage and processing systems such as Snowflake, BigQuery, Redshift, Cassandra, HDFS, Delta Lake, and Iceberg.
- Ensure high availability, monitoring, automated failover, and recovery across compute and storage clusters.
- Collaborate with data scientists, ML engineers, and product teams on secure and cost-efficient data platforms.
Requirements
- 6+ years of professional software engineering experience, including work with data infrastructure, distributed systems, or large-scale analytics platforms.
- Deep experience with distributed data processing frameworks such as Spark or Flink.
- Strong background in cloud-scale data architecture on AWS, Azure, or GCP, including data lakes, warehouses, and streaming platforms.
- Proficiency in Python, Java, Scala, or Go.
- Experience with modern data warehouse and lakehouse technologies such as Snowflake, Databricks, BigQuery, or Redshift.
- Understanding of data modeling, ETL/ELT design, pipeline orchestration, scalability, reliability, and production cost efficiency.
Nice to have
- Experience with HTAP systems or real-time analytics platforms.
- Familiarity with Parquet, ORC, Delta, Iceberg, or Hudi.
- Knowledge of Docker, Kubernetes, and cloud-native data architectures.
- Background in query engine development or open-source OLAP/OLTP frameworks.
Culture & Benefits
- Unlimited paid time off, 12 paid holidays, and paid volunteer time.
- Paid parental leave, including extended leave for birthing parents.
- Medical, dental, and vision coverage from the first day.
- Mental health support, therapy sessions, and digital wellness tools.
- 401(k) retirement plan with company matching contributions.
- Learning resources, mentoring, workshops, and professional development events.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
6 дней назад
Data Operations Engineer (Hybrid)
137 510 - 195 000$
7 дней назад
Senior Manager, Data Engineering (AI)
192 100 - 307 800$
23 часа назад
Data Engineer (AI)
112 400 - 174 500$
5 дней назад
Senior Field Specialist - Data Engineering & Streaming (Pre-Sales)
166 000 - 230 000$
Plaid
5 дней назад
Senior Data Engineer
191 000 - 239 000$
4 дня назад
Staff Data Engineer (Fintech)
131 600 - 210 300$