Назад
Company hidden
3 дня назад

Senior Data Engineer, Foundations (Spark)

206 000 - 290 000$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer, Foundations (Spark): Building and operating large-scale ETL pipelines, data lakes, and foundational datasets processing billions of daily events with an accent on scalability, reliability, data modeling, and observability. Focus on architecting distributed data systems, developing self-serve ETL frameworks, and solving complex data quality and performance challenges across product, ML, and data science workflows.

Location: Hybrid at the San Francisco or Seattle hubs, United States

Salary: $206K–$290K annual base pay, varying by US compensation zone, knowledge, skills, and experience.

Company

hirify.global is an AI productivity suite and product company whose products serve more than 40 million daily users and include Docs, Fathom, Go, GPTZero, Grammarly, Mail, and hirify.global Go.

What you will do

  • Architect, build, and own large-scale Spark/Databricks data pipelines and data lakes processing billions of daily events into reliable datasets.
  • Design systems supporting secure, scalable real-time and batch data processing.
  • Own data quality, freshness, reliability, monitoring, alerting, and automated checks for foundational datasets.
  • Build ETL frameworks and tooling that enable data teams and data scientists to self-serve reusable, documented datasets and business entities.
  • Partner with product, backend, ML engineering, and data science teams to develop data products for features, research, and experimentation.
  • Collaborate with leadership on the team charter and technical roadmap.

Requirements

  • 7+ years of experience building and operating large-scale distributed systems, including data engineering and data modeling.
  • 5+ years running live production environments, including high-load or data-intensive workflows focused on uptime and reliability.
  • High proficiency in SQL and Python, with deep hands-on experience in Spark and a modern lakehouse or cloud data warehouse such as Databricks, Delta Lake, dbt, Snowflake, or similar.
  • Strong knowledge of ETL/ELT design patterns, orchestration tools such as Airflow, dbt, or Dagster, data quality frameworks, and Git-based CI/CD for data.
  • Strong data modeling and data warehouse design skills, with a rigorous approach to data quality and observability.
  • Hands-on experience with modern data storage technologies such as Delta Lake, Snowflake, BigQuery, or Redshift.
  • Ability to evaluate in-house development against third-party solutions while balancing speed, scalability, and long-term viability.
  • Clear communication, cross-functional collaboration, end-to-end ownership, and the ability to translate business needs into reliable data solutions and metrics.
  • Strong problem-solving skills for scalable, highly complex data processing, including prioritization across multiple projects in a fast-paced environment.

Nice to have

  • Experience with high-throughput real-time streaming systems such as Kafka, Flink, or Spark Structured Streaming at billions-of-events-per-day scale.
  • Experience with Delta Lake, Iceberg, or Hudi and cloud infrastructure as code such as Terraform.
  • Experience building self-serve data products, tools, or frameworks used by other teams.
  • Experience partnering with analytics, data science, or machine learning teams to productionize data and models.

Culture & Benefits

  • Dynamic hybrid work model combining focused work with in-person collaboration at a US hub.
  • Medical, dental, vision, mental health, fertility, disability, and life insurance benefits.
  • 401(k) and RRSP matching, paid parental leave, and flexible sick time.
  • 20 paid vacation days, 12 paid holidays, and two floating holidays annually.
  • Stipends for caregiving, pet care, wellness, home office needs, and other expenses.
  • Annual professional development budget and learning opportunities.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →