Senior AI Inference Engineer (AI)

TL;DR

Senior AI Inference Engineer (AI): Working on the C++ layer that powers local AI, enhancing inference engines like llama.cpp and ONNX, to run efficiently on edge devices. Focus on making models load faster, run leaner, and perform well across different hardware, ensuring the inference layer is stable, optimized, and ready for integration with the rest of the stack.

Company

hirify.global is pioneering a global financial revolution, empowering businesses to integrate reserve-backed tokens across blockchains.

What you will do

• Deploy machine learning models to edge devices using frameworks like llama.cpp, ggml, and ONNX.
• Collaborate with researchers to assist in coding, training, and transitioning models from research to production environments.
• Integrate AI features into existing products.

Requirements

• Excellent programming skills in C++.
• Strong experience with Llama.cpp and ggml inference engines.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Demonstrated ability to rapidly assimilate new technologies and techniques.
• A degree in Computer Science, AI, Machine Learning, or a related field.

Culture & Benefits

• Global talent powerhouse, working remotely from every corner of the world.
• Opportunity to collaborate with some of the brightest minds in the fintech space.
• Contribute to the most innovative platform on the planet.