Назад
Company hidden
3 дня назад

Senior Software Engineer (AI Inference)

Формат работы
remote (только Poland)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Poland
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Software Engineer (AI Inference): Building prompt processing, tokenization, routing, scheduling, and batching systems for AI inference workloads with an accent on model serving, runtime frameworks, and high-throughput execution. Focus on integrating model architectures and serving backends, optimizing latency and throughput, and debugging performance-critical components across concurrent workloads.

Location: Remote from Poland

Company

hirify.global operates a distributed cloud and edge platform for content delivery, security, and AI applications.

What you will do

  • Develop and maintain prompt processing and tokenization pipelines for efficient model execution.
  • Implement request routing, scheduling, and batching logic for concurrent inference workloads.
  • Integrate new model architectures and serving backends into the runtime framework.
  • Write tested and documented code and participate in code reviews.
  • Support operational readiness through monitoring, debugging, and performance analysis.

Requirements

  • Relevant professional experience and a Bachelor's degree or equivalent in Computer Science or a related field.
  • Proficiency in Python and at least one systems programming language: C++, Go, or Rust.
  • Understanding of natural language processing concepts, including tokenization, encoding, and text processing pipelines.
  • Familiarity with AI inference, model serving, or LLM deployment, including TensorRT, vLLM, TorchServe, or Triton.
  • Experience building high-throughput, low-latency data processing systems or services.
  • Familiarity with Linux systems, containerized environments, and profiling or debugging tools.
  • Willingness to learn and grow in AI inference and model serving.

Culture & Benefits

  • Health, well-being, financial, and broader employee benefits.
  • FlexBase supports working from home, in an office, or through a combination of both according to the job's needs.
  • Work on cloud, edge, security, content delivery, and AI infrastructure serving global digital experiences.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →