Назад
Company hidden
3 дня назад

Software Engineer, Knowledge Engine – Data Infrastructure

180 000 - 350 000$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Switzerland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Software Engineer, Knowledge Engine – Data Infrastructure (Distributed Data Systems/Knowledge Graphs): Building construction pipelines that transform web crawls, vendor datasets, APIs, and external sources into a typed, evidence-backed knowledge graph with an accent on entity resolution, truth discovery, lineage, and data correctness. Focus on incremental computation over continuously changing data, idempotent and resumable processing, schema evolution, and eventually consistent graph updates at massive scale.

Location: Onsite in Zurich, Switzerland

Salary: $180K–$350K per year plus equity

Company

hirify.global builds a knowledge engine that synthesizes information from the web and other sources into a large, evidence-backed open-domain knowledge graph for factual answers.

What you will do

  • Build construction pipelines that transform web crawls, vendor datasets, APIs, and other sources into ontology-shaped claims with provenance, timestamps, and confidence.
  • Integrate new sources using versioned append-only history, schema evolution, replayable cursors, and support for late-arriving and corrected records.
  • Resolve entities across billions of records and reconcile conflicting claims using source reliability, recency, and corroboration.
  • Build incremental computation over change data feeds with idempotent, resumable jobs and eventually consistent graph updates.
  • Develop evaluation, coverage, correctness, and lineage systems to measure precision and completeness and identify failing sources or processing stages.

Requirements

  • Production experience building and operating large-scale distributed data pipelines over petabytes of structured and unstructured data.
  • Experience with Spark and a lakehouse format such as Delta Lake, Iceberg, or Hudi, including the ability to read and tune Spark query plans.
  • Deep understanding of incremental processing, including change data capture, idempotent writes, backfills, and reprocessing.
  • Strong Python skills and proficiency in at least one systems language.
  • Strong focus on correctness, reliability, data quality, and scale.

Nice to have

  • Experience with entity resolution, record linkage, knowledge graphs, or ontologies.
  • Experience with information extraction or truth discovery at scale.
  • Experience with Lance or other columnar/vector-native formats.

Culture & Benefits

  • Greenfield engineering work with foundational architectural decisions and broad scope.
  • Full-time employment with equity included in the compensation package.
  • Equal opportunity employment regardless of legally protected characteristics.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →