Назад
Company hidden
6 дней назад

Senior Software Engineer (Databricks)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Software Engineer (Databricks) (Data Engineering): Building and maintaining scalable Databricks lakehouse pipelines and reporting data models that power personalization and analytics for education products with an accent on PySpark, Spark SQL, Delta Lake, and Unity Catalog. Focus on optimizing large-scale data processing, designing reliable serving layers, and implementing data quality, observability, governance, and access controls.

Location: Remote in Ohio, United States

Company

hirify.global is a learning science company delivering personalized learning experiences and education products for students, parents, educators, and professionals.

What you will do

  • Translate business requirements into technical specifications and solution designs with product and engineering leaders.
  • Build and maintain scalable batch and incremental data pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
  • Design reporting data models using dimensional modeling and medallion architecture.
  • Build and optimize the Unity Catalog SQL serving layer, including views, materialized views, and table-valued functions.
  • Tune Spark and SQL performance, manage compute costs, and maintain data quality, observability, and reliability through automation, testing, and monitoring.
  • Apply data governance and access controls, lead design reviews, and mentor engineers on data engineering practices.

Requirements

  • 5+ years of software or data engineering experience, including 3+ years building production data pipelines on Databricks or an equivalent Spark platform in AWS.
  • Experience delivering production-grade, fault-tolerant software in a fast-paced environment with a distributed team.
  • Advanced SQL skills, including tuning complex analytical queries over large datasets.
  • Expertise in data warehousing, lakehouse concepts, data modeling, and cloud data architecture.
  • Strong applied knowledge of several of Unity Catalog governance, batch and incremental ETL/ELT, Spark performance tuning, REST services, AWS data services including Athena, Glue, EMR, and Lambda, Terraform, GitHub Actions, and Git.
  • Bachelor’s degree in Computer Science or a related field, or equivalent experience.

Nice to have

  • Education or publishing domain experience.
  • Streaming or CDC ingestion, such as Kafka into Delta Lake.
  • Data quality frameworks including Delta Live Tables and Great Expectations.
  • Databricks certification.

Culture & Benefits

  • Opportunity to work on reporting and personalization features at scale for products used by millions of users.
  • Culture focused on curiosity, innovation, and professional growth.
  • Remote role associated with Ohio, United States.
  • Automated employment decision tools are used in screening, with an opt-out alternative available.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →