Senior Software Engineer (Analytics Data Platform Lakehouse)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Software Engineer (Analytics Data Platform Lakehouse): Building and operating the foundations of a petabyte-scale lakehouse platform with an accent on Apache Iceberg table management and query engine integration. Focus on optimizing data layout, designing self-serve tooling for data pipelines, and contributing to open-source projects like Trino and Spark.
Location: Hybrid in New York, NY, USA
Salary: $130,000 — $300,000 USD
Company
is a leading observability and security platform providing unified visibility across the technology stack to manage complexity at scale.
What you will do
- Design and operate core lakehouse components, including Apache Iceberg table management and catalogs.
- Drive adoption of open table formats by integrating Trino, Spark, and other query engines at petabyte scale.
- Build observability for managed tables to identify performance bottlenecks and contribute fixes to upstream open-source projects.
- Develop self-serve tooling and abstractions that allow data engineering teams to run thousands of pipelines per day.
- Collaborate with cross-functional teams to define the lakehouse architecture roadmap and scale analytic data management.
Requirements
- BS/MS/PhD in Computer Science, Engineering, or equivalent professional experience.
- Production-grade experience with Apache Iceberg, Trino, or Apache Spark, preferably with open-source contributions.
- Experience building and operating large-scale distributed data systems.
- Strong knowledge of query planning, columnar file formats (Parquet, ORC), and table format internals.
- Fluency in Java, Scala, or Go, and proficiency in Python for tooling.
- Experience deploying data infrastructure on Kubernetes in cloud environments.
- Must be based in or able to work in a hybrid setup in New York, USA.
Culture & Benefits
- Competitive salary and equity package.
- Comprehensive healthcare, dental, and mental health benefits.
- 401(k) plan with company match.
- Paid time off and fitness reimbursements.
- Discounted employee stock purchase plan.
- Hybrid workplace supporting work-life harmony.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →