AI Solutions Architect

Location: 100% remote, open only to candidates residing in the United States

Company

hirify.global provides a fully managed crowdsourced testing platform powered by proprietary intelligence technology, with global coverage across devices, payment methods, countries, and languages.

What you will do

• Define and maintain the AI testing service catalog, including offerings, tiers, packaging, delivery methodology, staffing models, and pricing structure.
• Design testing approaches for complex AI-powered applications, including autonomous agents, system prompts, foundation models, and RAG architectures.
• Support sales and engagement teams with discovery, scoping, technical advisory, and articulation of the AI testing value proposition.
• Advance the AI testing framework by combining deterministic code graders, LLM-as-a-judge evaluation, and human-in-the-loop validation.
• Act as a delivery escalation point, solve technical roadblocks, stand up environments, and make testing solutions scalable and repeatable.
• Create templates, curated training datasets, documentation, and thought-leadership materials for internal and external audiences.

Requirements

• Extensive hands-on experience developing, training, or fine-tuning machine learning models, NLP systems, or data pipelines.
• Hands-on familiarity with modern LLM evaluation frameworks such as DeepEval and RAGAs.
• Direct experience working with, deploying, or testing autonomous agent architectures, planning patterns, or multi-agent systems, including frameworks such as LangGraph, AutoGen, or CrewAI.
• Strong software engineering foundations and experience with deterministic and non-deterministic systems.
• Proven client-facing experience leading discovery calls, stakeholder workshops, and enterprise architecture consulting.
• Experience designing service offerings, understanding pricing dynamics, and developing go-to-market strategies in professional services or SaaS.

Culture & Benefits

• Fully remote and globally distributed work environment with asynchronous collaboration.
• Flexible paid time off, including national holidays, personal days, and sick days.
• Stock options and a $300 annual learning stipend.
• Inclusive, purpose-driven culture with an emphasis on collaboration, sustainable work practices, and professional development.
• Enterprise, global, subscription-based business with long-term customer relationships.

Hiring process

• Application and recruiter interview.
• TestGorilla assessment followed by approximately four team and stakeholder interviews.
• Reference checks, offer, and background check; the process typically takes 3–4 weeks.