Назад
8 месяцев назад

Staff / Senior Software Engineer (Agentic Search) - Index (AI)

Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
UK/Netherlands
Вакансия из списка Hirify.GlobalВакансия из Hirify RU Global, списка компаний с восточно-европейскими корнями
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff / Senior Software Engineer (Agentic Search) - Index (AI): Building large-scale indexing systems and offline and nearline data pipelines for an agent-native search platform with an accent on throughput, freshness, scalability, and correctness. Focus on designing queryable data structures, storage and compaction strategies, observability signals, and reliable processing across continuously evolving petabyte-scale datasets.

Location: Amsterdam, Netherlands, or London, United Kingdom

Company

Nebius builds a full-stack AI cloud platform for data processing, model training, and production deployment, with infrastructure spanning compute, storage, networking, and applied AI.

What you will do

  • Design, implement, and operate large-scale indexing systems and data pipelines for an agent-native search platform.
  • Build offline and nearline pipelines that ingest, process, and organize massive datasets into efficient, queryable structures.
  • Optimize indexing strategies, storage formats, compaction approaches, and update mechanisms for performance, freshness, and resource efficiency.
  • Ensure pipeline reliability and predictable operation at throughputs of tens of gigabytes per second.
  • Define observability primitives, including structured logs, metrics, and data quality signals, while monitoring throughput, resource usage, and cost.
  • Collaborate with runtime and ML teams to align indexing outputs with retrieval and ranking requirements and enable controlled experimentation.

Requirements

  • 5+ years of experience building production backend or data infrastructure systems.
  • Strong experience with Go.
  • Experience with large-scale data processing systems, including 10+ GiB/sec throughput or petabyte-scale datasets.
  • Experience building or operating databases, storage systems, data planes, or indexing pipelines.
  • Strong understanding of distributed systems, fault tolerance, consistency, and scalability.
  • Experience running production systems, handling operational incidents, and reasoning about end-to-end data flows.

Nice to have

  • Experience with C++ or Rust.
  • Experience with Spark, Flink, MapReduce, Beam, scraping, proxying, anti-bot infrastructure, or large-scale content platforms.
  • Knowledge of DBMS internals and cloud infrastructure.
  • Open-source contributions, competitive programming, CTF participation, advanced technical programs, conference talks, or technical publications.

Culture & Benefits

  • Competitive compensation and opportunities for career growth and learning.
  • Flexible environment with ownership of technical decisions.
  • Collaborative, innovative, and international working environment.
  • Opportunity to build impactful AI infrastructure with experienced engineering teams.
  • Applicants must be authorized to work in the country in which they apply and provide proof of employment eligibility.

Hiring process

  • Coding interviews are part of the selection process.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →