Назад
7 дней назад

Staff Software Engineer - Compiler & Spark Runtime (Spark)

236 000 - 339 200$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff Software Engineer - Compiler & Spark Runtime (Spark): Building compiler and runtime integration that translates Spark workloads into efficient execution on Snowflake’s cloud-native query engine with an accent on query-plan lowering, Spark compatibility, performance, and reliability. Focus on designing compiler capabilities, optimizing SQL generation and compilation latency, validating correctness against Apache Spark, and leading production rollouts.

Location: Hybrid in Bellevue, WA or Menlo Park, CA, United States

Salary: $236K–$339.2K annually

Company

Snowflake provides a cloud-native data platform and is developing AI-enabled capabilities for the agentic enterprise.

What you will do

  • Design and implement Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and SQL generation.
  • Own complex initiatives from problem definition and architecture through implementation, validation, and production rollout.
  • Provide technical leadership through architectural decisions, design and code reviews, trade-off alignment, and technical blocker resolution.
  • Improve workload performance and cost efficiency through profiling, compilation-latency reduction, metadata-access improvements, and query-engine collaboration.
  • Establish correctness, compatibility, observability, incident investigation, fault recovery, and safe rollout practices.
  • Mentor engineers and partner with compiler, query engine, runtime, product, and senior technical teams to define priorities and measurable outcomes.

Requirements

  • 10+ years of hands-on software engineering experience, including substantial work on compilers, query-processing systems, or runtime infrastructure.
  • Experience serving as a technical lead for complex initiatives and guiding engineers without formal management authority.
  • Track record of designing, implementing, and delivering production systems with ownership of significant architectural and implementation decisions.
  • Deep expertise in at least one relevant area: compiler architecture and IR transformations, relational query processing, language semantics and type systems, or runtime integration.
  • Proficiency in Scala, Java, C++, or a comparable implementation language, with the ability to write and review production code.
  • Strong systems fundamentals in concurrency, memory behavior, and performance analysis, plus experience debugging complex production issues.
  • Ability to translate technical and customer requirements into engineering priorities and collaborate across teams and locations.
  • Strong technical communication and mentorship skills, including building alignment around architectural decisions and explaining complex trade-offs.

Nice to have

  • Experience with Apache Spark internals, Catalyst, Spark Connect, or DataFrame APIs.
  • Experience with relational algebra, SQL generation, query optimization, or database execution systems.
  • Experience with Scala/JVM performance, native runtime functions, metadata caching, or compilation-performance optimization.
  • Experience building compatibility-test frameworks, differential testing, performance benchmarks, or production observability for data systems.
  • Experience technically leading systems through customer adoption, production hardening, and staged releases.
  • Degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience.

Culture & Benefits

  • Full-time engineering role in a fast-growing environment focused on innovation and measurable technical impact.
  • Work in a dynamic setting with an experimental mindset and AI as a high-trust collaborator.
  • Collaborate across compiler, query engine, runtime, product, and technical leadership teams.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →