Senior Machine Learning Engineer (Deep Learning, Computer Vision, Multimodal AI)

TL;DR

Senior Machine Learning Engineer (Deep Learning, Computer Vision, Multimodal AI): Designing, training, fine-tuning, and evaluating deep learning models for advanced video and vision-based systems with an accent on video representation learning, temporal modeling, and action recognition. Focus on implementing and improving detection, tracking, and segmentation pipelines and contributing to multimodal AI systems by integrating vision models with LLMs.

Location: Based in Portugal (Iberia region) for an energy infrastructure project.

Company

hirify.global is a digital product engineering company that builds inspiring, exciting, and delightful products, services, and experiences at scale globally with over 18,000 experts.

What you will do

• Design, train, fine-tune, and evaluate deep learning models using PyTorch/TensorFlow.
• Develop computer vision and video understanding models (CNNs, ViTs, 3D CNNs, SlowFast, I3D).
• Build solutions for video representation learning, temporal modeling, and action recognition.
• Implement and improve detection, tracking, and segmentation pipelines (YOLO, DETR, Mask R-CNN, SAM).
• Contribute to multimodal AI systems, integrating vision models with LLMs (CLIP, BLIP-2, LLaVA, Video-LLaMA).
• Prepare and manage video datasets and build efficient data and training pipelines for large-scale video processing.

Requirements

• 7+ years of experience in Machine Learning.
• Deep Learning expertise, with hands-on experience designing, training, fine-tuning, and evaluating custom neural networks.
• Strong proficiency with PyTorch (preferred) and TensorFlow.
• Strong Computer Vision fundamentals (CNNs, feature extraction, representation learning).
• Solid understanding of video processing and temporal modeling.
• Experience building end-to-end ML pipelines, from data preparation to model evaluation.

Nice to have

• Advanced PyTorch usage and optimization.
• Advanced Computer Vision skills (detection, tracking, segmentation).
• Experience with model optimization (performance, memory, latency).
• Exposure to multimodal systems (vision + language).
• Data Science on Azure.

Culture & Benefits

• Work in a dynamic and non-hierarchical culture.
• Opportunity to help teammates proceed in the right direction.
• Tackle client challenges and take solutions one step further.
• Join a distributed team of 18,000+ experts across 39 countries.