Software Engineering Architect (AI) - Slack

TL;DR

Software Engineering Architect (AI) - Slack: Building agent orchestration systems and SDK frameworks for seamless human-AI collaboration in Slack with an accent on LLM reasoning, planning, tool-calling, and human-in-the-loop safety. Focus on designing high-scale distributed systems, optimizing low-latency inference, and evolving developer tools for agent deployment at massive scale.

Location: Canada - Toronto

Company

hirify.global's Slack Agent Systems team pioneering Generative AI integration into workplace collaboration.

What you will do

• Architect high-scale agentic orchestration managing LLM loops, planning, and integrations with MuleSoft, Data Cloud, and third-party APIs.
• Define technical roadmap for human-in-the-loop checkpoints ensuring safe, autonomous agent operation in enterprise environments.
• Build and evolve the Agent SDK for internal/external teams to develop, test, and deploy Slack Agents.
• Optimize performance for low-latency inference, GPU workloads, and real-time streaming across millions of channels.
• Collaborate with Product, Security, and Data Science to advance Slack AI capabilities including long-term memory and shared state.
• Mentor teams, conduct design reviews, and standardize AI-first engineering practices like automated LLM evaluation.

Requirements

• 8+ years industry experience leading large-scale distributed systems or platform engineering.
• Deep expertise in LLM lifecycle: prompt engineering, RAG, agentic reasoning (ReAct, Chain-of-Thought).
• Strong proficiency in Java, Go, or Python; familiarity with Hack/PHP or TypeScript a plus.
• Experience with Kubernetes, Docker, AI providers (OpenAI, Anthropic, Einstein), vector databases (Pinecone, Milvus), Kafka, and Data Cloud.

Nice to have

• AI tool usage (Claude Code, Cursor, GitHub Copilot) to accelerate development.
• Security experience: guardrails, permissions, data masking, compliance (FedRAMP, HIPAA).
• Open source contributions to agentic frameworks (LangChain, AutoGPT) or Slack ecosystem.