Software Engineer (Backend)

TL;DR

Software Engineer (Backend): Building the core data platform powering AI observability with an accent on high-availability ingestion pipelines, system scalability, and robust infrastructure for LLM development. Focus on designing reliable data systems, evolving open-source SDKs, and solving complex concurrency and integration challenges for AI workflows.

Location: Must be based in San Francisco, New York City, or Seattle (On-site)

Company

hirify.global is the AI observability platform that integrates evaluation and monitoring to help teams improve their AI production workflows.

What you will do

• Design and ship features providing deep insight into LLM usage and performance.
• Integrate, proxy, and collect data from major model providers like OpenAI, Anthropic, and Gemini.
• Develop and evolve robust open-source libraries for tracing and evaluating LLM calls in customer applications.
• Build high-availability, real-time data pipelines for storing and querying large volumes of AI usage data.
• Collaborate with product engineers to implement features like role-based access controls and enterprise data retention policies.

Requirements

• 5+ years of backend engineering experience across multiple stack layers.
• Strong systems thinking with proven experience in infrastructure projects and data integrity.
• Proficiency in modern backend technologies such as Node.js, Go, Python, or Rust.
• Experience with data management tools like Postgres and Redis.
• Proven ability to manage infrastructure using tools like Docker, Terraform, and AWS.
• Experience with observability tooling such as Grafana, Prometheus, or Datadog.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance.
• Daily office meals, snacks, and beverages.
• Flexible time off policy.
• Competitive compensation package including salary and equity.
• Dedicated AI stipend for professional growth.