Agentic Data Understanding Engineer (AI/Robotics)

Location: Hybrid in San Francisco, CA or New York, NY

Company

hirify.global builds autonomous construction robots that operate on real job sites and improve safety and efficiency in the construction industry.

What you will do

• Design and build cascading auto-labeling pipelines using sensor-derived labels, specialized AI models, and VLMs.
• Develop annotation quality and cost harnesses using golden and validation datasets.
• Productionize annotation workflows, including historical data backfills, fleet-wide coverage tracking, and automated runs on new data.
• Build the Annotation Orchestrator to manage job sequences, scheduling, prioritization, progress tracking, and vendor integrations.
• Create agentic workflows that diagnose quality gaps, handle low-confidence cases through human review, and trigger re-annotation after specification updates.
• Partner with data infrastructure engineers to support version-controlled annotation databases, semantic search, reporting, and quality/cost metrics.

Requirements

• 8+ years of experience in ML engineering, data engineering, or applied AI, including production annotation or labeling systems.
• Strong Python and experimentation skills, with experience building complex pipelines and running ML model inference at scale.
• Hands-on experience with annotation modalities such as 2D bounding boxes, 3D cuboids, semantic segmentation, or event/context labels.
• Ability to define quality and cost metrics and evaluate trade-offs in data pipelines.
• Ability to collaborate with autonomy engineers, product managers, and human labeling teams.
• Hybrid work is based in San Francisco, CA, or New York, NY.

Nice to have

• Experience fine-tuning machine learning models.
• Experience building agentic or LLM-orchestrated pipelines, including VLM-based zero-shot or few-shot annotation.
• Familiarity with robotics data formats and LiDAR, camera, and IMU sensor modalities.
• Experience with annotation platforms or designing ontologies and taxonomies for structured labeling.
• Background in robotics, autonomous vehicles, or construction technology.

Culture & Benefits

• Work with real-world autonomous systems deployed on construction sites.
• Collaborate with construction specialists and experienced robotics and engineering teams.
• Access rich fleet data and own meaningful technical scope from the start.
• Flexible roles and consideration for candidates in other locations, especially locations with Bedrock offices.
• Inclusive workplace with reasonable accommodations available throughout the hiring process.