Senior AI Inference Engineer (AI)

TL;DR

Senior AI Inference Engineer (AI): Building and optimizing C++ inference engines like llama.cpp and ONNX to run efficiently on edge devices without cloud infrastructure, with an accent on runtime performance, model loading, and lean execution. Focus on deploying machine learning models, integrating AI features, and ensuring stable, optimized inference layers for private and fast on-device AI.

Location: Fully remote, worldwide

Company

hirify.global is pioneering a global financial revolution by providing cutting-edge solutions for integrating reserve-backed tokens across blockchains, offering innovative products like USDT and driving advancements in AI and peer-to-peer technology.

What you will do

• Work on the C++ layer that powers local AI, porting and enhancing inference engines like llama.cpp, ONNX and similar.
• Focus on the runtime: making models load faster, run leaner, and perform well across different hardware.
• Deploy machine learning models to edge devices using frameworks such as llama.cpp, ggml, and ONNX.
• Collaborate with researchers to assist in coding, training, and transitioning models from research to production environments.
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning.

Requirements

• Excellent programming skills in C++.
• Strong experience with Llama.cpp and ggml inference engines.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Demonstrated ability to rapidly assimilate new technologies and techniques.
• A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D.
• English: C1+ required for excellent communication skills.

Culture & Benefits

• Join a global, fully remote talent powerhouse.
• Opportunity to make a mark in the fintech space.
• Collaborate with bright minds, pushing boundaries and setting new standards.
• Contribute to an innovative platform and pioneer a global financial revolution.
• Be part of a fast-growing, lean industry leader.