Principal Machine Learning Systems Engineer (GenAI Products & Knowledge Innovations)

Location: Remote in the United States, with listed locations in Washington, DC, Mountain View, and San Francisco

Salary: $236,700–$309,025 in Zone A; $213,030–$278,123 in Zone B; $196,461–$256,491 in Zone C

Company

hirify.global develops software products that help teams collaborate and manage work.

What you will do

• Architect and implement scalable systems for training, fine-tuning, and serving large language models and embeddings.
• Build retrieval, hybrid search, and RAG pipelines using knowledge-grounded data.
• Develop infrastructure for experimentation, evaluation, and deployment of GenAI prototypes.
• Partner with applied scientists, ML engineers, backend developers, and product teams to deliver production-ready services.
• Optimize latency, throughput, resource efficiency, monitoring, evaluation, and reliability for GenAI workloads.

Requirements

• 6+ years of experience in ML systems engineering, backend engineering, or infrastructure roles.
• Production experience building and scaling ML-powered services, including model training, inference, or search and retrieval systems.
• Proficiency with Python, PyTorch, TensorFlow, and Hugging Face.
• Experience with vector databases such as Weaviate, Pinecone, or FAISS, and orchestration frameworks such as LangChain or LlamaIndex.
• Experience with AWS, GCP, or Azure, plus Kubernetes and Docker.
• Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related field, or equivalent industry experience.

Nice to have

• Background in distributed systems, high-performance computing, or GPU optimization.
• Familiarity with search and GenAI evaluation metrics such as NDCG, groundedness, and latency benchmarks.
• Experience with observability and reliability practices for ML systems.
• Contributions to open-source infrastructure or ML systems frameworks.

Culture & Benefits

• Choice of working from an office, from home, or through a combination of both.
• Health and wellbeing resources.
• Paid volunteer days.
• Benefits and support for employees and their families.
• Workplace accommodations are available during the recruitment process.