Назад
Company hidden
30 минут назад

Data Engineer (Databricks)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
middle
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Engineer (Databricks): Building and supporting scalable data pipelines and observability solutions for mission-critical public health analytics with an accent on Databricks, Palantir Foundry, PySpark, SQL, and cloud-native orchestration. Focus on designing schemas and transformations, improving partitioning and query performance, implementing data-quality controls, and supporting production reliability and platform migrations.

Location: Remote, Oregon, United States; must be a U.S. Citizen or Lawful Permanent Resident

Salary: Market competitive, commensurate with experience and education

Company

hirify.global provides strategic consulting, program management, and data-driven analytics for federal public health agencies and national public health initiatives.

What you will do

  • Develop, maintain, and support scalable data pipelines and platform components using Databricks and Palantir Foundry.
  • Design and improve observability metadata models, standards, and frameworks for monitoring, data quality, operational visibility, and platform reliability.
  • Implement schemas and transformations with PySpark and SQL, troubleshoot processing issues, and improve partitioning and query performance.
  • Configure cloud-native orchestration workflows, contribute to CI/CD pipelines, and develop automated tests and validation checks.
  • Support Palantir Foundry onboarding, platform migrations, reusable libraries, templates, documentation, and modernization of Python and SQL analytics code.
  • Implement security, governance, data-quality, and monitoring controls while collaborating with analysts, program teams, and CDC partners.

Requirements

  • 3+ years of hands-on data engineering experience, including PySpark, SQL, distributed data processing, and developing, maintaining, troubleshooting, and supporting production data pipelines.
  • 1+ year of Databricks experience, including Delta Lake, job orchestration, and familiarity with Unity Catalog.
  • 1+ year of Microsoft Azure experience, including Azure Data Factory, Azure Functions, and Azure Storage, or equivalent AWS or GCP services.
  • Experience designing and supporting observability data platforms; implementing schema designs, medallion architecture, partitioning strategies, and performance improvements.
  • Experience with Palantir Foundry, including datasets, transforms, pipeline development, and data modeling.
  • Ability to complete engineering tasks independently, collaborate cross-functionally, escalate technical issues, gather requirements, and explain technical solutions to technical and non-technical audiences.
  • Bachelor’s degree.
  • Must be a U.S. Citizen or Lawful Permanent Resident and able to obtain and maintain a Public Trust or Suitability/Fitness determination, including Public Trust 5 security clearance, based on client requirements.

Nice to have

  • Experience with CI/CD for data engineering and application services using Azure DevOps or equivalent tooling.
  • Experience with data-quality checks, observability, monitoring, data security, governance, data-platform onboarding, cloud migration, or modernization of Python and SQL analytics code.
  • Knowledge of Agile, DevOps, and DataOps practices.
  • Knowledge of Generative AI concepts and tools, including RAG, LLMs, and embedding models.

Culture & Benefits

  • Full-time remote position supporting federal public health initiatives.
  • Medical, dental, vision, and life insurance.
  • Paid time off and 401(k) with company match.
  • Growth and promotion opportunities.
  • Equal opportunity employer, including veterans and people with disabilities.

Hiring process

  • Interview responses must be based on the candidate’s own knowledge, skills, and experience; AI tools and third-party resources may not be used to generate or assist interview responses.
  • AI-assisted interview responses may result in disqualification from further consideration.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →