Software Engineer, AI (LLM Agents)

TL;DR

Software Engineer, AI (LLM Agents): Building and optimizing state-of-the-art LLM-powered agents for reasoning, planning, and workflow automation, with an accent on retrieval-augmented generation (RAG), retrieval pipelines, and evaluation frameworks. Focus on designing scalable agentic search and retrieval systems, improving relevance with hybrid retrieval and re-ranking, and ensuring low-latency, accurate production performance.

Location: Toronto, Ontario

Salary: CA$115K – CA$149K (Offers Equity)

Company

hirify.global builds AI agents that generate market, competitor, and buyer insights in a unified platform.

What you will do

• Design and implement retrieval-augmented generation (RAG) systems with agentic workflows for query understanding, retrieval, and response synthesis.
• Build and optimize retrieval pipelines using BM25, dense retrieval, hybrid retrieval, and re-ranking.
• Develop evaluation pipelines for retrieval and generation, including offline metrics and human-in-the-loop evaluation.
• Experiment with query rewriting, expansion, and classification to improve retrieval relevance.
• Collaborate with Product to bring ML-powered search agents into production and iterate on user intent alignment.
• Profile, debug, and optimize latency, accuracy, and scalability of retrieval and generation components.

Requirements

• Software engineering experience.
• Experience with information retrieval systems, search relevance, and ranking models.
• Expertise in Python, with experience in PyTorch, TensorFlow, or JAX.
• Familiarity with LLMs, prompt engineering, and RAG pipelines.
• Understanding of evaluation methods for search systems, including offline metrics and user-facing evaluation.
• Experience with vector database infrastructure (e.g., FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (e.g., Elasticsearch, OpenSearch).

Nice to have

• Experience with agentic system design for LLM workflows.
• Background in conversational search.
• Contributions to open-source projects in retrieval, NLP, or LLM ecosystems.

Culture & Benefits

• Office-first work with hybrid touch; collaborate in the office on Mondays, Wednesdays, and Thursdays.
• Extended health & dental coverage starting on Day 1, plus perks like discounts at Goodlife and Perkopolis.
• Employee Stock Option Plan participation for full-time employees.
• Vacation policy focused on taking time as needed with notice to avoid leaving teams hanging.
• Top-tier tools (Mac or PC) and encouragement to use AI to work smarter.
• Annual company-wide kickoff in Vancouver and regular hub social events; dog-friendly offices in Vancouver and Toronto.