Lead AI Inference Engineer (AI)

TL;DR

Lead AI Inference Engineer (AI): Leading a cross-functional pod to ensure reliable and performant local AI capabilities across devices with an accent on deploying machine learning models to edge devices using frameworks like llama.cpp, ggml, and onnx. Focus on integrating AI features into existing products and managing a team of engineers to produce high-quality deliverables.

Location: Remote

Company

Tether is pioneering a global financial revolution by building cutting-edge solutions that empower businesses to seamlessly integrate reserve-backed tokens across blockchains.

What you will do

• Deploy machine learning models to edge devices using frameworks like llama.cpp, ggml, and onnx.
• Collaborate with researchers to assist in coding, training, and transitioning models from research to production environments.
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning.
• Manage a cross-functional team (pod) of middleware (JS), foundation (C++), QA, and documentation engineers.
• Assess the market position with regards to similar products or platforms.
• Ensure stable releases by following precise internal release processes.

Requirements

• Excellent programming skills in C++.
• Strong experience with Llama.cpp and ggml inference engines.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Demonstrated ability to rapidly assimilate new technologies and techniques.
• Experience managing a small, specialized, cross-functional team (pod) of 3-5 people.
• A degree in Computer Science, AI, Machine Learning, or a related field.

Nice to have

• Extensive experience with Javascript/Typescript.
• Experience with AWS, containerization platforms, orchestration, and automated testing suites (Maestro, Appium).
• Understanding of the difficulties, nuances, and importance of p2p technology.
• Experience with MLC, TVM, or similar frameworks.
• Experience with Vulkan, CUDA.
• Experience with productionized models.

Culture & Benefits

• Global talent powerhouse, working remotely from every corner of the world.
• Opportunity to collaborate with some of the brightest minds in the fintech space.
• Contribute to the most innovative platform on the planet.