Lead AI Inference Engineer (AI)

TL;DR

Lead AI Inference Engineer (AI): Leading a cross-functional pod to deploy machine learning models to edge devices, ensuring reliable AI capabilities across devices. Focus on balancing hands-on technical work with team coordination, guiding engineers toward shared goals to deliver cohesive, production-ready local AI systems.

Location: Remote

Company

Tether is pioneering a global financial revolution with reserve-backed tokens across blockchains.

What you will do

• Deploy machine learning models to edge devices using frameworks like llama.cpp, ggml, and onnx.
• Collaborate with researchers to code, train, and transition models from research to production.
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning.
• Manage a cross-functional team to produce high-quality deliverables.
• Assess the company's position in the market with regards to similar products or platforms.
• Ensure stable releases by following precise internal release processes.

Requirements

• Excellent programming skills in C++.
• Strong experience with Llama.cpp and ggml inference engines.
• Good understanding of deep learning concepts and model architectures.
• Experience with transformers and LLMs.
• Demonstrated ability to rapidly assimilate new technologies and techniques.
• Experience managing a small, specialized, cross-functional team.
• A degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D.

Nice to have

• Experience with Javascript/Typescript.
• Experience with AWS, containerization platforms, orchestration, and automated testing suites.
• Understanding of p2p technology.
• Experience with MLC, TVM, Vulkan, or CUDA.
• Experience productionizing models.

Culture & Benefits

• Global talent powerhouse working remotely from every corner of the world.
• Opportunity to collaborate with some of the brightest minds in the fintech space.
• Contribute to the most innovative platform on the planet.