Senior Data Analyst III (AI Evaluation)

Location: Home-based in New York

Salary: $115,400–$192,200 annual base pay for home-based New York; New York City: $125,900–$209,700; Rochester, NY: $104,900–$174,700. Eligible for an annual incentive bonus.

Company

hirify.global provides information, analytics, and evidence-based solutions supporting scientific research, healthcare education, and clinical practice.

What you will do

• Lead requirements gathering and develop analytics frameworks for evaluating generative AI models in healthcare applications.
• Define the strategic direction for AI evaluation methodologies within the product area.
• Manage the analytics roadmap, evaluation timelines, and deliverables with internal and external stakeholders.
• Develop and deploy queries and metrics to assess model performance and output quality.
• Create and maintain data models for AI evaluation frameworks and monitoring systems.
• Conduct quality assurance of AI outputs and participate in risk analysis and mitigation, including considerations for HIPAA, PHI, and PII.

Requirements

• 6–9 years of relevant experience in data analytics.
• Bachelor’s degree in mathematics, science, or a related field; a Master’s degree or PhD is preferred.
• Experience developing evaluation frameworks and leading enterprise-wide analytics strategy and project implementation.
• Expertise querying relational database management systems such as Microsoft SQL Server, Snowflake, or PostgreSQL.
• Expertise with BI tools such as Tableau or Power BI.
• Demonstrated experience using Python for analysis.

Culture & Benefits

• Flexible working hours to support productivity and work-life balance.
• Wellbeing initiatives, family leave, and tuition reimbursement.
• Comprehensive health plan, disability insurance, life and accident insurance, and spending accounts for dependent care and commuting.
• Retirement benefits, including a salary investment plan and employer stock purchase plan.
• Modern family benefits, including adoption and surrogacy support.
• Inclusive, collaborative, agile, and innovative work environment.