Software Engineer - Ai Performance (Ai Engineering)

TL;DR

Software Engineer - AI Performance (AI Engineering): Building and scaling benchmarking infrastructure for evaluating AI systems in enterprise settings with an accent on profiling, telemetry, and performance tuning. Focus on designing agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.

Location: Remote

Company

hirify.global is ushering in the SaaS 2.0 era where enterprise software is intelligent and reintroducing the Computer to the enterprise as an agent that thinks, reasons, and acts on behalf of users.

What you will do

• Participate in a structured training track to develop expertise in AI benchmarking, profiling, and performance tuning.
• Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.
• Design agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.
• Collaborate with AI and Infra teams to instrument model-serving systems (vLLM, Triton, Ray, or Kubernetes-based deployments).
• Develop data and telemetry pipelines that capture model performance, latency, and quality.
• Work with cross-functional teams to ensure benchmarks reflect real-world customer value and system impact.

Requirements

• 3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles.
• Strong foundation in Python or similar backend languages — Go, Java, C#, or Node.js.
• Hands-on experience in building APIs and cloud-native architectures (AWS, GCP, or Azure; Kubernetes a plus).
• Understanding of metrics, profiling, or observability tools (Grafana, Prometheus, ELK, or similar).
• Curiosity and commitment to learn AI benchmarking, LLM evaluation, and performance frameworks.
• Strong analytical and product intuition — you care about what the benchmark represents, not just what it measures.

Nice to have

• Bonus: exposure to vector search, model tuning (LoRA, DPO), or open-source contributions

Culture & Benefits

• The foundation of hirify.global is its culture -- our commitment to those who are hungry, humble, honest, and who act with heart.
• Our vision is to help build the earth’s most customer-centric companies.
• Our mission is to leverage design, data engineering, and machine intelligence to empower engineers to embrace their customers.