Senior Software Engineer, AI/ML (AI Infrastructure & Platform)

Location: Hybrid, New York City, United States

Salary: $200,000–$250,000 per year, plus equity

Company

hirify.global provides an estate planning technology platform for wealth management and financial institutions, combining proprietary AI, security, and legal expertise.

What you will do

• Design and build platforms for LLM orchestration, tool execution, and multi-step agent workflows.
• Develop shared services, SDKs, APIs, and reusable abstractions for AI applications and agent capabilities.
• Build infrastructure for state management, tool routing, retries, failure handling, and reliable interaction with sensitive data.
• Create offline and online evaluation frameworks with logging, tracing, and monitoring for AI behavior and system performance.
• Develop scalable RAG pipelines, indexing systems, and structured and unstructured data processing workflows.
• Partner with AI Applications engineers to translate product needs into secure, reliable, and cost-efficient infrastructure.

Requirements

• Degree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experience.
• Strong software engineering fundamentals, including system design, distributed systems, and maintainable code.
• Production experience building and operating systems at scale, including backend systems, APIs, or infrastructure platforms.
• Proficiency in Python, TypeScript, and C#, with the ability to work across a polyglot stack.
• Production experience with AI/ML systems, including LLM integrations, data pipelines, or AI platform infrastructure.
• Experience with cloud infrastructure, containerized or serverless deployments, event-driven systems, queues, async processing, MLOps, CI/CD, and production monitoring.

Nice to have

• Experience with RAG systems and vector databases such as Pinecone, Weaviate, or pgvector.
• Experience with agent orchestration frameworks such as LangGraph or LangChain.
• Experience designing tooling layers, capability abstractions, or evaluation and observability systems for AI.
• Experience in regulated domains such as LegalTech, FinTech, or HealthTech.
• Familiarity with data privacy and security techniques, including PII handling and redaction.

Culture & Benefits

• Collaborative and supportive environment focused on innovation and ownership.
• Medical, dental, and vision insurance with low-cost premium options.
• Company-paid basic life insurance and short- and long-term disability insurance.
• Paid parental leave upon eligibility.
• Company equity managed through Carta and a 401(k) with matching and immediate vesting.
• Flexible PTO, paid holidays, and birthday time off.