Domain Expert Lead (AI)

TL;DR

Domain Expert Lead (AI): Analyzing and evaluating Large Language Models (LLMs) across various domains, focusing on data integrity and ensuring high standards of quality. Focus on translating domain expertise into actionable insights and collaborating with AI research teams to improve LLM capabilities.

Location: Remote (US)

Salary: $97,500 - $185,000/year

Company

hirify.global is an equal opportunity employer and has an inclusive culture that empowers hirify.globalians to deliver the best results for our customers.

What you will do

• Critically analyze and evaluate responses generated by our LLMs across various domains and use cases in your area of expertise.
• Develop and write demonstrations to illustrate "what good data looks like" in terms of meeting benchmarks for quality and efficiency.
• Participate in the creation of tooling that helps create data by providing your feedback on what works and what doesn’t.
• Champion effective knowledge-sharing initiatives by translating domain expertise into actionable insights, while cultivating strategic partnerships across multidisciplinary teams.
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output.
• Collaborate with the AI research team to identify areas for improvement in the LLM’s capabilities.

Requirements

• 1+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) or statistical/mathematical software (e.g. R, SAS, Matlab, etc.) experience
• 2+ years of data/research scientist, statistician or quantitative analyst in an internet-based company with complex and big data sources experience
• 1+ years of creating or contributing to mathematical textbooks, research papers, or educational content experience
• Master's degree in Science, Technology, Engineering, or Mathematics (STEM), or experience working in Science, Technology, Engineering, or Mathematics (STEM)

Nice to have

• Ph.D. in Science, Technology, Engineering, or Mathematics (STEM)
• Knowledge of statistical packages and business intelligence tools such as SPSS, SAS, S-PLUS, or R
• Knowledge of machine learning concepts and their application to reasoning and problem-solving
• Experience working with or evaluating AI systems
• Experience applying quantitative analysis to solve business problems and making data-driven business decisions

Culture & Benefits

• Full range of medical, financial, and/or other benefits.
• Equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package.
• Inclusive culture empowers hirify.globalians to deliver the best results for our customers.