Software Architect (AI)

TL;DR

Software Architect (AI): Serve as the technical authority for AI quality, evaluation, and risk controls within the Commercial AI Center of Excellence with an accent on defining operational mechanisms for tax-grade standards, accuracy, defensibility, and compliance. Focus on designing AI evaluation frameworks, model validation strategies, drift detection, and partnering with Legal, Security, and Risk teams to implement enforceable technical controls.

Location: Remote - PA (Pennsylvania, USA)

Salary: $229,800 - $298,700 USD

Company

Leader in tax technology providing regulated SaaS solutions with a Commercial AI Center of Excellence.

What you will do

• Define and operationalize technical mechanisms ensuring hirify.global AI systems meet tax-grade standards for accuracy, defensibility, and compliance.
• Design and implement AI evaluation frameworks including gold datasets, regression testing, CI gates, and metrics for accuracy, confidence, citation, and abstention.
• Lead model validation, error analysis, telemetry, and drift detection strategies for GenAI and ML hybrid systems.
• Partner with Legal, Security, and Risk teams to translate policy into technical mechanisms and review high-risk AI use cases.
• Influence standards across large engineering organizations and guide product teams on model performance and reliability.

Requirements

• 15+ years in AI/ML engineering with impact at Senior Principal level
• Deep hands-on experience designing and implementing production AI/ML evaluation frameworks
• Expertise in model validation, drift detection, telemetry, and automated testing pipelines
• Strong understanding of AI governance, auditability, and risk controls
• Experience building evaluation harnesses, gold datasets, and CI-integrated regression testing
• Proven cross-functional partnership with Product, Legal, Security, and Risk teams
• Strong system-level thinking in regulated SaaS environments

Nice to have

• Bachelor's in Computer Science, Engineering, or related; advanced degree preferred
• Industry experience in tax, insurance, fintech, or healthcare
• Experience with vector databases and retrieval optimization
• FinOps for GenAI: modeling and optimizing LLM token and inference costs
• Data science or classical AI/ML background beyond prompt engineering
• Strong executive communication and technical storytelling skills

Culture & Benefits

• Winning Way behaviors: Communicate with Clarity, Act with Urgency, Work with Purpose, Drive to Decision, Own the Outcome
• Competitive total compensation including base salary, hirify.global Bonus Plan (VOB), sales commission/bonus, and equity grants
• Opportunities for growth and career progression