Назад
Company hidden
2 дня назад

Data Engineer (Databricks)

99 150 - 162 885$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Engineer (Databricks): Building and maintaining scalable batch and real-time data pipelines and governed data assets for analytics, machine learning, and generative AI with an accent on Python, PySpark, SQL, and cloud-native lakehouse technologies. Focus on designing dimensional and domain-oriented data models, implementing data quality and observability controls, and optimizing production pipelines for reliability and performance.

Location: Hybrid, in office 3 days per week, based in Bethlehem, PA; New York, NY; or Holmdel, NJ. Up to 10% travel within NY/NJ/PA.

Salary: $99,150–$162,885 base pay, plus potential incentive compensation.

Company

hirify.global provides insurance and related financial protection services while supporting data-driven business initiatives across its enterprise and subsidiaries.

What you will do

  • Build and maintain reliable batch and real-time ingestion pipelines for databases, files, APIs, event streams, and third-party data sources.
  • Develop and operationalize scalable pipelines with Python, PySpark, SQL, and Databricks to transform raw data into trusted, business-ready assets.
  • Design dimensional and domain-oriented data models, schemas, data contracts, and optimized data structures.
  • Implement schema evolution, error handling, observability, automated data-quality checks, alerting, and service-level objectives.
  • Build governed data assets supporting analytics, machine learning, and generative AI use cases.
  • Collaborate with architects, data scientists, product management, IT, business leaders, and cross-functional development teams through design, testing, code review, and documentation.

Requirements

  • 10+ years of IT experience, including 5+ years as a data architect, data engineer, or other data professional.
  • Expert knowledge of relational and NoSQL database concepts, with hands-on experience in PostgreSQL, Oracle, Databricks, and cloud-native data stores.
  • Expert proficiency in logical, physical, dimensional, and domain-oriented data modeling, including schema design and data contracts.
  • Extensive experience with distributed data processing and lakehouse technologies, including Python and PySpark on Databricks.
  • Experience designing and optimizing large-scale data pipelines and data-warehouse architecture using batch and incremental processing, change data capture, orchestration, and schema evolution.
  • Experience with AWS data services and modern cloud data platforms, including Amazon S3, PostgreSQL, and Databricks.
  • Expert SQL skills covering complex queries, performance optimization, data transformations, and scalable data-structure design.
  • Ability to design secure, scalable cloud-native solutions across object storage, lakehouse platforms, SaaS integrations, relational databases, and NoSQL stores.
  • Strong data sourcing, profiling, mapping, analysis, communication, collaboration, problem-solving, stakeholder management, empathy, listening, and constructive-feedback skills.
  • Reltio proficiency and experience with Agentic AI development using Bedrock.
  • Must be legally authorized to work in the United States without current or future employer sponsorship.

Nice to have

  • Experience with enterprise modeling tools.
  • SAFe experience and ability to work on cross-functional, self-organizing development teams.

Culture & Benefits

  • Full-time employment with support for professional and personal goals.
  • Skill-building, leadership development, and philanthropic opportunities.
  • Contemporary, supportive, flexible, and inclusive benefits and resources for eligible full-time employees.
  • Work involves collaboration with stakeholders across the enterprise and adapting to changing business priorities.
  • Up to 10% travel within the NY/NJ/PA locations is required.

Hiring process

  • Current Guardian colleagues must apply through the internal Jobs Hub in Workday.
  • Applicants may opt out of AI-assisted preliminary screening by emailing the accommodation contact within ten business days of applying and providing their name and requisition identification number.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →