AI Engineer (C++)

TL;DR

AI Engineer (C++): Building and optimizing the runtime layer powering local AI on edge devices with an accent on porting and enhancing inference engines. Focus on improving model loading, memory efficiency, and inference speed to deliver reliable on-device AI performance.

Location: UK Fully Remote

Salary: £35,000 - £45,000 per annum

Company

hirify.global is recruiting for a client developing privacy-focused AI systems that operate independently of cloud infrastructure.

What you will do

• Deploy and optimize ML models for edge and on-device environments using llama.cpp, ggml, and ONNX.
• Improve inference runtime performance across various CPU and GPU architectures.
• Collaborate with AI researchers to transition models from research into production-ready deployments.
• Support model integration, optimization, and runtime stability throughout the deployment lifecycle.
• Integrate advanced AI capabilities into existing products and systems.
• Contribute to the enhancement of local inference infrastructure and tooling.

Requirements

• Strong C++ programming skills with experience in high-performance systems.
• Hands-on experience with inference engines such as llama.cpp and ggml.
• Knowledge of deploying models to specific GPU architectures and optimizing inference workloads.
• Solid understanding of deep learning concepts, transformer architectures, and LLMs.
• Experience working with ONNX and related model deployment frameworks.
• Degree in Computer Science, AI, ML, or equivalent practical experience.

Nice to have

• Experience with JavaScript or cross-platform application integration.
• Familiarity with low-level performance optimization and hardware acceleration.
• Experience working on edge AI, embedded systems, or privacy-focused AI products.

Culture & Benefits

• Fully remote work arrangement within the UK.
• 6-month contract role (Outside IR35).
• Opportunity to work close to the metal on cutting-edge on-device AI.
• Competitive benefits package.