Senior Manager, Psychometric Operations & Data Science

TL;DR

Senior Manager, Psychometric Operations & Data Science (Data Science): Leading the operational execution and continuous improvement of psychometric data workflows for LATAM assessments with an accent on scoring cycles, item calibration, and reporting efficiency. Focus on modernizing data pipelines, reducing manual processes, and implementing AI-enabled tools for QA and anomaly detection.

Location: Hybrid in San Juan, Puerto Rico, or Remote from Continental USA. Must be a resident of the USA with work authorization.

Salary: $64,000–$125,000 (depending on location)

Company

A self-sustaining nonprofit dedicated to expanding educational opportunity and advancing evidence-based decision-making through scientifically rigorous assessments.

What you will do

• Manage recurring scoring cycles to ensure timelines, accuracy, and QA standards are met.
• Execute psychometric data workflows including item analysis, calibration, and scaling.
• Modernize data pipelines and reduce manual, error-prone processes using SQL, R, or Python.
• Define operational requirements for automated checks, dashboards, and pipeline enhancements.
• Partner with Technology and R&M teams to ensure scoring and reporting processes are scalable and reproducible.
• Mentor colleagues in reproducible data practices and responsible use of automation.

Requirements

• Master's degree in Data Science, Statistics, Psychology, Psychometrics, or a related field.
• 5+ years of experience in psychometrics, educational measurement, or advanced statistical analysis.
• Strong technical fluency in SQL and at least one programming language (R or Python).
• Bilingual proficiency in Spanish and English.
• Resident in USA with authorization to work for any employer.
• Knowledge of item response theory (IRT), classical test theory, scaling, and equating.

Nice to have

• Experience with large-scale assessment, credentialing, or certification programs.
• Familiarity with cloud-based data environments and modern data platforms.
• Comfort using AI-enabled tools for QA, anomaly detection, and workflow automation.

Culture & Benefits

• Meaningful, mission-driven work focused on expanding educational opportunities.
• Fair and competitive compensation based on qualifications and market data.
• Supportive team environment emphasizing growth, curiosity, and iterative learning.
• Commitment to diversity, shared success, and transparent communication.

Hiring process

• Initial recruiter phone/video screen and hiring manager interview.
• Performance exercise involving data analysis or workflow review.
• Panel interview, leadership conversation, and final reference checks.