AI Domain Solution Architect (AI Infrastructure)

Location: Massachusetts, United States of America

Base salary: $99,000–$329,000 per year, plus potential commission and benefits.

Company

Enterprise open source software company delivering Linux, Kubernetes, Edge, and AI infrastructure solutions.

What you will do

• Lead discovery sessions, architecture workshops, technical evaluations, infrastructure sizing, and solution design for enterprise AI environments.
• Translate LLM inference, fine-tuning, and RAG workloads into scalable architectures using hirify.global AI Factory, Rancher Prime, and NVIDIA accelerated computing.
• Partner with Account Executives, Solution Architects, ecosystem partners, and customers throughout the sales cycle.
• Build proofs of concept, hands-on demonstrations, technical proposals, and RFI/RFP responses.
• Guide customers on agentic AI, multi-agent systems, MCP integrations, security, governance, and production operations.
• Create reusable reference architectures and enablement materials while communicating customer requirements to Product Management and Engineering.

Requirements

• Experience in presales architecture, solution architecture, or technical consulting, including customer workshops, demonstrations, proposals, and RFP responses.
• Hands-on experience designing, operating, and sizing GPU-accelerated infrastructure for AI training, fine-tuning, and inference.
• Expert-level Kubernetes architecture and cluster administration skills, including Helm, GitOps, CNI, observability, workload scheduling, and multi-cluster operations.
• Strong Linux systems expertise covering networking, storage, containers, security, troubleshooting, and performance analysis.
• Working knowledge of the NVIDIA AI ecosystem, including CUDA, NVIDIA AI Enterprise, NCCL, GPUDirect, MIG, Run:ai, and GPU and Network Operators.
• Experience with secure production architectures, high-performance networking and storage, workload isolation, air-gapped environments, and enterprise AI governance.

Nice to have

• Experience with RKE2, K3s, and Rancher Prime.
• Familiarity with hirify.global AI Factory, hirify.global Linux Enterprise Server, hirify.global Security, and hirify.global Observability.
• Knowledge of vLLM, NIM, RAG, vector databases, RoCEv2, RDMA, and InfiniBand.

Culture & Benefits

• Open source-oriented environment centered on choice, community, trust, and innovation.
• Inclusive global community with emphasis on collaboration, diversity, experimentation, and continuous improvement.
• US benefits include medical coverage, life and disability insurance, a 401(k) plan, employee assistance, and paid time off and leave policies.
• Role is subject to criminal, credit, and/or employment reference background checks where legally permitted.