Senior AI Engineer (LLM)

TL;DR

Senior AI Engineer (LLM): Designing and building production-grade LLM-powered systems, including agents and RAG pipelines, with an accent on software engineering and applied AI. Focus on integrating LLMs with internal services, architecting retrieval strategies, and building evaluation harnesses for non-deterministic systems.

Location: Israel - Tel Aviv

Company

hirify.global is a data platform company building enterprise software infrastructure to capture, catalog, and protect massive datasets for the AI era.

What you will do

• Design, build, and operate LLM-powered applications, agents, and workflows from prototype to production.
• Architect retrieval, context engineering, and tool-use strategies to ensure models are reliable and cost-efficient.
• Integrate LLMs with internal services and third-party APIs (REST, gRPC) to automate complex business and engineering workflows.
• Build and continuously improve evaluation harnesses for non-deterministic systems.
• Collaborate with product, research, and platform teams to translate ambiguous problems into shipped capabilities.
• Monitor and integrate the latest advancements in the LLM ecosystem, including new models and agentic patterns.

Requirements

• Strong Python skills with a focus on clean, idiomatic, and well-tested code.
• Hands-on experience using coding agents (Cursor, Claude Code, GitHub Copilot) to build complex systems.
• Experience with SQL (PostgreSQL, MySQL) and NoSQL (MongoDB, Redis, DynamoDB) database paradigms.
• Proficiency with Docker, Kubernetes, and Linux fundamentals (bash/terminal).
• Experience building cloud-native tools on AWS, GCP, or Azure.
• Deep understanding of LLM mechanics (tokenization, attention, context windows) and modern patterns like RAG, MCP, and vector databases.

Nice to have

• Experience fine-tuning or distilling open-source models.
• Contributions to open-source AI/ML projects.
• Experience with streaming, real-time systems, or low-latency inference.
• Familiarity with prompt evaluation frameworks and LLM-as-judge methodologies.
• Background in distributed systems or high-scale backend engineering.

Culture & Benefits

• High-ownership role in one of the fastest-growing infrastructure companies in history.
• Opportunity to work at the frontier of the AI revolution.
• Cross-functional environment collaborating across all company departments.
• Builder's mindset culture focusing on shipping, measuring, and iterating.