Senior AI Inference Engineer (Llama.cpp Specialist)

TL;DR

Senior AI Inference Engineer (Llama.cpp Specialist): Working on the C++ layer to enhance inference engines like llama.cpp and ONNX to efficiently run on edge devices with an accent on runtime optimization for faster model loading and leaner operation across diverse hardware. Focus on enabling private and fast on-device AI without cloud infrastructure dependency, ensuring the inference layer is stable and ready for integration.

Location: Remote

Company

Tether is building products and pioneering a global financial revolution.

What you will do

• Deploy machine learning models to edge devices using frameworks like llama.cpp, ggml, and ONNX.
• Collaborate with researchers to assist in coding, training, and transitioning models from research to production.
• Integrate AI features into existing products, enriching them with the latest machine learning advancements.

Requirements

• Excellent programming skills in C++.
• Experience with Llama.cpp and ggml inference engines.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Ability to rapidly assimilate new technologies and techniques.
• A degree in Computer Science, AI, Machine Learning, or a related field.

Culture & Benefits

• Global talent powerhouse working remotely from every corner of the world.
• Opportunity to collaborate with some of the brightest minds in the fintech space.
• Contribute to an innovative platform.