Staff Research Scientist, Dexterous Manipulation (AI)

TL;DR

Staff Research Scientist, Dexterous Manipulation (AI): Engineering and innovating unique robotic manipulation tasks by creating, developing, and enhancing cutting-edge Reinforcement Learning (RL) and Imitation Learning (IL) algorithms with an accent on data collection, real-world implementation on humanoid robots, and novel haptic/proprioceptive sensing techniques. Focus on devising RL/IL training and data collection pipelines, optimizing large-batch parallel simulations, and ensuring successful sim-to-real transfer.

Location: On-site in Vancouver, BC, Canada

Company

hirify.global builds humanoid robots and a novel control system for them that integrates symbolic logic and reasoning with data-driven robot foundation models.

What you will do

• Create, develop, and enhance cutting-edge Reinforcement Learning (RL) and Imitation Learning (IL) algorithms and evaluate their performance in practical applications.
• Stay current with the latest developments in RL/IL techniques and their application in robotics.
• Identify, communicate, and lead research initiatives to the wider ML team.
• Discover strategies for enhancing current RL/IL learning processes considering key performance metrics like sample efficiency, speed, computational resources, and scalability.
• Devise RL/IL training and data collection pipelines to expedite implementation on physical robots.
• Collaborate within a diverse team to devise innovative algorithms and investigate the root causes of errors in existing implementations.

Requirements

• Ph.D. in Machine Learning, Computer Science, Applied Mathematics, or equivalent practical background in Reinforcement Learning and/or Imitation Learning.
• 5+ years of hands-on experience implementing and deploying robotic manipulation tasks, both in simulation and on physical robots.
• 5+ years of practical experience applying various Reinforcement Learning and/or Imitation Learning methods, with focus on robotics in the real world.
• 4+ years experience in developing and optimizing large-batch parallel simulations for Reinforcement Learning.
• Proven expertise in continual learning, sim-to-real transfer, and transitioning Machine Learning research into production.
• Active involvement in integrating Machine Learning models into a robotics platform.
• A track record of publishing research in esteemed AI conferences.
• Development with Python 3.8 or later.
• Working knowledge of PyTorch and/or TensorFlow.
• Familiarity with ROS2.
• Expertise in use of Reinforcement Learning principles and their application.

Culture & Benefits

• Market-leading compensation package including competitive salaries and equity stakes.
• Full suite of benefits for permanent employees, encompassing health coverage and paid time off.
• Cutting-edge work facilities and worksite flexibility by role.
• Commitment to fairness ensuring total compensation consistently surpasses market standards.
• hirify.global is an equal opportunity employer.