Research Engineer, Frontier Safety Risk Assessment (AI)

TL;DR

Research Engineer, Frontier Safety Risk Assessment (AI): Designs, implements, and validates approaches to assessing and managing catastrophic risk from current and future frontier AI systems. Focus on building decision-relevant and trustworthy evaluation systems that prioritize compute and effort on risk measurements with the highest value of information.

Location: Must be based in San Francisco, California, US

Salary: $136,000 - $245,000 + bonus + equity + benefits

Company

hirify.global is a team of scientists, engineers, machine learning experts working together to advance the state of the art in artificial intelligence.

What you will do

• Identify new risk pathways within current areas or in new ones.
• Conceive of, design, and develop new ways to measure pre-mitigation and post-mitigation risk.
• Forecast and scenario planning for future risks which are not yet material.
• Contribute to research as well as engineering.

Requirements

• Extensive research experience with deep learning and/or foundation models (for example, a PhD in machine learning).
• Adept at generating ideas and designing experiments, and implementing these in Python with real AI systems.
• Keen to address risks from foundation models.
• Strong, clear communication skills.

Nice to have

• Experience in areas such as frontier risk assessment and/or mitigations, safety, and alignment.
• Engineering experience with LLM training and inference.
• PhD in Computer Science or Machine Learning related field.
• A track record of publications at venues such as NeurIPS, ICLR, ICML, RL/DL, EMNLP, AAAI and UAI.
• Experience with collaborating or leading an applied research project.

Culture & Benefits

• Enhanced maternity, paternity, adoption, and shared parental leave.
• Private medical and dental insurance for yourself and any dependents.
• Flexible working options.
• Excellent facilities such as healthy food, an on-site gym, faith rooms, terraces etc.