Machine Learning Engineer: Perception (Robotics)

Location: San Francisco, CA; hybrid

Company

hirify.global deploys autonomous systems on heavy construction equipment to improve job-site safety and accelerate critical infrastructure projects.

What you will do

• Design and train early-fusion architectures, including BEV-based transformers, that combine raw Lidar and camera data for object detection and semantic segmentation.
• Build robust perception systems for dynamic occlusion, dust, snow, rain, and high-vibration environments.
• Optimize machine-learning models for inference on embedded hardware and debug calibration drift, latency bottlenecks, and other system-level issues.
• Develop state-of-the-art representations for downstream robotics use cases in collaboration with other engineering teams.

Requirements

• 3+ years of experience taking deep-learning models from research to production using PyTorch, TensorFlow, or JAX.
• Strong understanding of 3D geometry, SE(3) transformations, homogeneous coordinates, and intrinsic/extrinsic sensor calibration.
• Practical experience with feature-level multimodal fusion architectures such as BEVFusion, TransFuser, or PointPainting.
• Experience with modern transformer-based object-detection and temporal architectures, including DETR, PETR, PETRv2, or StreamPETR.
• Expertise in Python and ability to read and write systems code in C++ or Rust, with knowledge of memory management and real-time constraints.
• Ability to investigate data infrastructure and improve ground-truth quality and data alignment.

Nice to have

• Experience with occupancy grids, NeRFs, or voxel-based representations for terrain mapping.
• Research publications at venues such as ICRA, IROS, CVPR, ECCV, ICCV, CoRL, or RSS.

Culture & Benefits

• Work alongside construction professionals and engineers on physical-world autonomy problems.
• Flexible roles and consideration for candidates who do not meet every criterion or who are based in another location, especially near offices such as San Francisco or New York.
• Inclusive workplace with equal-opportunity employment practices.
• Reasonable accommodations are available throughout the hiring process.