AI Research Engineer (Pre-training)

TL;DR

AI Research Engineer (Pre-training): Driving innovation in architecture development for cutting-edge AI models of various scales with an accent on pre-training optimization, data curation, and resolving bottlenecks. Focus on exploring and implementing novel techniques and algorithms to advance the field and push the limits of AI performance on large-scale distributed systems.

Location: Remote (Global)

Company

hirify.global is pioneering a global financial revolution by providing cutting-edge solutions for integrating reserve-backed tokens across blockchains and driving innovation in energy, AI, and digital education.

What you will do

• Conduct pre-training of AI models on large-scale distributed servers equipped with thousands of NVIDIA GPUs.
• Design, prototype, and scale innovative architectures to enhance model intelligence.
• Execute experiments, analyze results, and refine methodologies for optimal performance.
• Investigate, debug, and improve both model efficiency and computational performance.
• Contribute to the advancement of training systems to ensure seamless scalability and efficiency on target platforms.

Requirements

• A degree in Computer Science or related field, ideally a PhD in NLP, Machine Learning, or a related field, complemented by a solid track record in AI R&D (with good publications in A* conferences).
• Hands-on experience contributing to large-scale LLM training runs on large, distributed servers equipped with thousands of NVIDIA GPUs.
• Familiarity and practical experience with large-scale, distributed training frameworks, libraries and tools.
• Deep knowledge of state-of-the-art transformer and non-transformer modifications aimed at enhancing intelligence, efficiency and scalability.
• Strong expertise in PyTorch and Hugging Face libraries with practical experience in model development, continual pretraining, and deployment.
• Excellent English communication skills.

Culture & Benefits

• Work remotely from every corner of the world as part of a global talent powerhouse.
• Opportunity to collaborate with bright minds in the fintech space.
• Contribute to an innovative platform pioneering a global financial revolution.
• Be part of a fast-growing, lean industry leader.

Hiring process

• Application requires answering specific questions about experience and research.
• Do not use AI tools when completing this application.
• Opportunity to record or upload a video.