Senior/Staff Software Engineer (AI Infrastructure)

TL;DR

Senior/Staff Software Engineer (AI Infrastructure): Designing and building core components of a next-generation knowledge retrieval system with an accent on scalable search and retrieval infrastructure for agentic systems. Focus on optimizing indexing pipelines, improving retrieval quality through RAG patterns, and enhancing system reliability for high-throughput workloads.

Location: Hybrid in Tel Aviv

Company

hirify.global is the leading vector database for building accurate and performant AI applications at scale in production.

What you will do

• Design and build scalable platform components leveraging query planning, semantic and hybrid search, and LLM generation.
• Develop optimized indexing pipelines for both structured and unstructured data.
• Build backend services for semantic and hybrid retrieval, knowledge graph construction, and retrieval orchestration.
• Improve retrieval quality through the implementation of evaluation and observability frameworks.
• Design clean, intuitive APIs for internal users and autonomous agentic consumers.
• Optimize latency, throughput, and cost across large-scale inference and retrieval workloads.

Requirements

• 6+ years of experience shipping production-grade backends for large-scale systems.
• Expertise in at least one major language: Go, Rust, C++, Java, or Python.
• Direct experience or deep theoretical knowledge in semantic search, vector databases, hybrid retrieval, or search engines like Elastic/OpenSearch.
• Strong understanding of Retrieval-Augmented Generation (RAG) patterns, embedding pipelines, and metadata filtering.
• Experience with Kubernetes, cloud-native architectures, and IaC tools like Terraform or Pulumi.
• Must be based in Tel Aviv for hybrid work.

Nice to have

• Experience building multi-tenant SaaS platforms.
• Experience with retrieval evaluation frameworks to measure search result quality.
• Experience with query planning or agentic reasoning loops.