Staff Software Engineer (AI)

TL;DR

Staff Software Engineer (AI): Leading the development of new features and foundational capabilities for LLM Observability products, focusing on monitoring, explaining, and improving AI systems in production. Focus on shaping product direction, driving experimentation, and applying deep understanding of AI systems and software engineering to solve open-ended problems in the fast-moving AI landscape.

Location: Hybrid, requiring attendance in offices in Boston, Massachusetts, USA or New York, New York, USA.

Salary: $234,000–$300,000 USD

Company

hirify.global is a monitoring and security platform for cloud applications, providing robust observability for AI workloads.

What you will do

• Drive design and implementation of LLM observability features.
• Ideate, prototype, and scale new product features to provide insights and drive improvements for generative AI systems.
• Work cross-functionally with other engineering teams, product, UX, and applied science.
• Develop and extend tools for tracing, evaluating, and debugging LLMs.
• Influence architecture decisions and mentor engineers to build resilient, high-performance systems.
• Stay current with industry trends and advancements in machine learning and observability, driving innovation within the team.

Requirements

• BS/MS/PhD in Computer Science, Engineering or a related scientific field, or equivalent experience.
• Deep understanding of distributed systems and scalable backend architectures.
• Hands-on experience building and shipping LLM-powered or Generative AI applications.
• Understanding of model internals, inference pipelines, evaluation techniques, and prompt engineering.
• Ability to thrive in ambiguous, fast-changing spaces with a product-oriented mindset.
• Experience with observability tools/platforms.
• Work authorization for the USA is required.

Culture & Benefits

• Build tools for software engineers and use them to accelerate development.
• Have significant influence on product direction and business impact.
• Work with skilled, knowledgeable, and kind teammates.
• Access competitive global benefits and continuous professional development.
• Comprehensive and inclusive employee benefits including healthcare, dental, parental planning, and mental health benefits.
• Benefit from a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.