Software Engineer (AI Platform)

TL;DR

Software Engineer (AI Platform): Developing and maintaining an internal AI platform enabling safe, scalable, and cost-effective AI solutions across multiple business units. Focus on building core AI services, complex agentic workflows, and LLM evaluation and optimization processes.

Location: Hybrid in Israel

Company

hirify.global provides an intuitive, data-driven HR platform for mid-size businesses globally, supporting over 1 million users and 4500 companies.

What you will do

• Design and implement AI platform services including agent orchestration, prompt management, RAG, connectors, and evaluation pipelines.
• Develop multi-step agentic workflows with observability, guardrails, and cost controls using frameworks like OpenAI Agent SDK or LangGraph.
• Build LLM evaluation harnesses, offline/online experiments, prompt-testing frameworks, and dashboards to optimize quality, latency, and cost.
• Collaborate across product, customer success, sales, operations, data, and IT teams to deliver platform capabilities.

Requirements

• Location: Hybrid work model in Israel
• 5+ years of software engineering experience building production systems at scale
• Strong proficiency in Python and practical knowledge of databases
• Experience with LLM/AI application patterns and vendor APIs (OpenAI or similar)
• Familiarity with vector stores, evaluation frameworks, prompt/version management, and cost/latency optimization
• Clear written and verbal communication skills to drive alignment with design documentation and reviews

Nice to have

• Experience building developer platforms or internal tooling
• Familiarity with workflow orchestration tools like Airflow, Prefect, or Dagster
• Hands-on experience with model optimization, fine-tuning, or distillation techniques
• Experience with cloud infrastructure (AWS), containers (Docker, Kubernetes), and distributed systems
• Frontend development experience with React
• Background in SaaS/enterprise environments with compliance requirements (SOC2, GDPR)

Culture & Benefits

• Flexible hybrid working model with work from home allowance
• Company share options plan and competitive compensation
• Payment for sick leave from day one and social impact volunteering days
• Annual wellness benefits including Headspace subscription
• Employee referral program with bonuses and ambassador program
• Transportation allowance, dog-friendly office, and team social events
• Temporary remote work from anywhere worldwide for up to 2 months after 6 months employment
• Additional company-wide long weekend days (Bob balance days)