Senior Principal AI Solutions Engineer

Location: San Jose, California, United States

Base salary: $234,000–$286,000 USD per year

Company

hirify.global develops full-stack AI inference infrastructure based on its RDU dataflow architecture and SambaRack rack-scale systems.

What you will do

• Design and build production-ready single-agent and multi-agent systems with planning, tool calling, MCP, memory, and long-running workflows.
• Develop self-improving systems using automated evaluations, LLM-as-judge workflows, trace-driven optimization, synthetic data, and fine-tuning.
• Build evaluation, tracing, observability, guardrail, benchmarking, and performance workflows covering quality, latency, and cost.
• Select, adapt, serve, fine-tune, distill, route, and integrate open-weight models on the hirify.global platform.
• Deliver full-stack vertical applications with Python, TypeScript, React or Next.js, including RAG, document analysis, knowledge assistants, workflow automation, multimodal, and voice solutions.
• Lead strategic customer engagements, technical workshops, architecture reviews, mentorship, reference architectures, platform feedback, and SambaStack tooling.

Requirements

• Bachelor’s degree or higher in Computer Science, Electrical Engineering, Applied Mathematics, Physics, Statistics, or a related field.
• 8+ years of industry experience for IC5 or 10+ years for IC6 in software, ML, or solutions engineering, including 3+ years building production LLM applications.
• Hands-on experience with agentic systems, tool and function calling, multi-agent orchestration, and frameworks such as LangGraph, CrewAI, OpenAI Agents SDK, or Claude Agent SDK.
• Expert Python skills plus modern front-end development with TypeScript and React or Next.js, APIs, and cloud deployment.
• Experience with open-weight model serving, prompting, LoRA or PEFT fine-tuning, LLM evaluation, and end-to-end benchmarking.
• Strong customer communication and technical leadership skills, including executive workshops, architecture direction, mentoring, and ownership of strategic outcomes.

Nice to have

• Experience with self-improving systems, reinforcement learning from feedback, synthetic data, or continual fine-tuning.
• Experience with real-time voice agents, ASR, TTS, speech-to-speech, streaming, and turn-taking.
• Experience with multimodal and vision-language models, document understanding, enterprise-scale RAG, agent security, and guardrails.
• Familiarity with vLLM, SGLang, TensorRT-LLM, hardware-aware performance tuning, MCP, and knowledge-work domains.
• Open-source contributions, public demos, or technical content in the AI community.

Culture & Benefits

• Full-time US employment with equity and benefits.
• Medical insurance with 95% employee premium coverage and 77% dependent premium coverage.
• Health Savings Account with employer contribution, Flexible Spending Accounts, dental, vision, disability, life, and AD&D insurance.
• Well-being benefits including Headspace, Gympass+, One Medical, and counseling through an Employee Assistance Program.