Назад
Company hidden
4 дня назад

Lead Data Engineer (Azure/Databricks)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead Data Engineer (Azure/Databricks): Building reliable, scalable ingestion and shared-service data engineering for an enterprise cloud data and analytics platform with an accent on data quality, governance, and platform modernization. Focus on designing fit-for-purpose ingestion patterns, operating Delta Lake and dedicated pools, implementing observability and parity checks, and optimizing data engineering KPIs.

Location: Fully remote, but applicants must be authorized to work in the United States and must reside and perform all work within the continental United States. Production monitoring coverage runs from 7:00 a.m. to 8:00 p.m. Eastern Time, with participation in a 24/7 on-call escalation process.

Company

hirify.global supports an enterprise cloud-based data and analytics platform for a federal health agency, modernizing legacy on-premises data warehouse tooling.

What you will do

  • Ingest new and migrated data sources using fit-for-purpose patterns aligned with source characteristics, operational constraints, and approved architecture.
  • Transform ingested data into semantic views, conformed dimensions, and performance-oriented models for analytics, reporting, and machine learning.
  • Operate and improve Delta Lake patterns and dedicated pool usage, ensuring parity with migrated platforms before release.
  • Implement equivalence, parity, freshness SLA, anomaly detection, and definition-of-done quality checks, publishing results and residual risks in release artifacts.
  • Instrument pipelines for monitoring, defect tracking, alerting, triage, rollback, and hot-fix operations; document lineage, orchestration, tuning, and architecture decisions.
  • Configure federated query tooling, advise on data architecture and ETL solutions, provision infrastructure, and monitor load, parallelism, quality, storage, and egress KPIs.

Requirements

  • Required expertise with Azure Data Factory, Databricks, and Kafka.
  • Experience with Databricks Unity Catalog for governance, security, lineage, and data and AI asset management.
  • Familiarity with Collibra and Immuta, or comparable enterprise data catalog and policy-based access control tooling.
  • Expertise in data ingestion, data engineering, and data quality disciplines.
  • Bachelor’s degree in a relevant field required.
  • 10+ years of relevant professional experience required.
  • Must be authorized to work in the United States and reside and perform all work within the continental United States.
  • Must be able to obtain and maintain a federal Public Trust (Tier 2 / Moderate Risk) background investigation.
  • Must participate in scheduled production support coverage and a 24/7 on-call escalation process.

Nice to have

  • Direct experience working in a federal agency environment.

Culture & Benefits

  • Fully remote work within the continental United States.
  • Production monitoring and support coverage from 7:00 a.m. to 8:00 p.m. Eastern Time.
  • Participation in a 24/7 on-call escalation process for urgent issues.
  • Employment is contingent upon contract award and client approval; interviews may occur before award to support rapid onboarding.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →