Software Engineer, Infrastructure, AI Labs (AI)

Location: New York, NY; must be authorized to work in the United States for any employer.

Salary: $175,000–$245,000 USD annually, with possible eligibility for an annual bonus.

Company

hirify.global AI Labs is an innovation and engineering hub building an AI platform for corporate legal departments and global law firms, including intelligent agents, reasoning engines, knowledge systems, and structured workflows for litigation, investigations, compliance, and corporate knowledge work.

What you will do

• Design the agentic platform used by engineering teams, including orchestration, tool registration and permissioning, durable state and memory, sandboxing, and trace-level observability.
• Build long-running agent workflows with multi-step reasoning, tool use, human-in-the-loop checkpoints, and recovery from partial failure.
• Design retrieval-augmented generation systems with hybrid search over legal corpora and citation grounding to specific sources.
• Build evaluation infrastructure with golden datasets, regression harnesses, and offline and online evaluation loops.
• Establish model-operations practices for routing, latency and cost budgets, prompt and context versioning, caching, and production reliability.
• Build scalable backend services and APIs, produce technical design documentation, and partner with product, research, security, and legal domain experts.

Requirements

• 5+ years of software-engineering experience with depth in backend, distributed, or AI systems.
• Production experience delivering and operating LLM-based applications at scale, beyond prototypes or proofs of concept.
• Experience with agentic architectures and orchestration frameworks, and retrieval-augmented generation systems at scale.
• Strong production-level proficiency in Python.
• Experience evaluating agentic-system accuracy and performance.
• Experience designing services and APIs consumed by other engineering teams.
• Experience with observability tooling such as Prometheus, Grafana, or OpenTelemetry, and with containerized cloud environments.
• Strong system-design and architecture experience, including production of technical design documents.
• Excellent written and verbal communication, including effective collaboration with non-technical domain experts and stakeholders.
• Demonstrated proficiency using AI tools in software development.

Nice to have

• Experience with fine-tuning, model adaptation, or systematic evaluation across model families.
• Experience with large-scale data pipelines or document-processing systems.
• Experience with multi-tenant SaaS architectures and data-isolation requirements.
• Experience in a startup or scale-up engineering environment.
• Experience in legal technology, enterprise workflow, or knowledge-management systems.

Culture & Benefits

• Collaborative, highly technical environment focused on rapid iteration, thoughtful design, and end-to-end ownership.
• Startup-like speed and autonomy with the resources of a global legal services provider.
• Enterprise-wide learning and mobility opportunities.
• Flexibility and respect for life beyond work.
• Values centered on integrity, service, collaboration, communication, and operational excellence.