Staff Software Engineer, Backend Platform (AI)

TL;DR

Staff Software Engineer (Backend Platform AI): Building and operating a cohesive backend platform for agentic AI in legal and professional services with an accent on shared frameworks, reliability, and developer experience. Focus on designing scalable abstractions, optimizing high-throughput model inference, and creating paved road patterns for product teams.

Location: Must be based in San Francisco or New York

Salary: $238,000 – $290,000 USD

Company

hirify.global is transforming legal and professional services by combining frontier agentic AI with an enterprise-grade platform.

What you will do

• Develop and maintain internal backend frameworks and libraries for API routing, caching, and messaging primitives.
• Create service templates and versioned interfaces to establish consistent architectural patterns.
• Implement modern backend patterns including asyncio and streaming data processing for improved scalability.
• Design abstractions for cross-cutting concerns such as authorization, data governance, and event processing.
• Embed reliability and observability into the platform via tracing, metrics, and automated shift-left testing.
• Collaborate with Model Infrastructure to solve GenAI challenges like high-throughput model inference and prompt lifecycle management.

Requirements

• 7+ years of software engineering experience building scalable backend systems or internal developer platforms.
• Proficiency in Python and deep knowledge of distributed systems and concurrency.
• Hands-on experience with Flask, FastAPI, and microservices architectures.
• Familiarity with Redis, Kafka, SQL/NoSQL, and Vector databases.
• Strong track record of writing high-quality, well-tested code using static typing and CI tools.
• Must be based in San Francisco or New York

Nice to have

• Experience contributing to or maintaining internal libraries and frameworks.

Culture & Benefits

• High-intensity environment driven by values of Decisiveness, Simplicity, and continuous improvement.
• Opportunity to work on a generational company at a true inflection point with strong product-market fit.
• Equity offers as part of the compensation package.
• Commitment to excellence and ownership within a world-class team.