AI Research Engineer (Pre Training)

TL;DR

AI Research Engineer (Pre Training): Driving innovation in architecture development for cutting-edge AI models of various scales. Focus on exploring and implementing novel techniques and algorithms that lead to groundbreaking advancements in data curation and pre-training optimization.

Location: Remote

Company

hirify.global pioneers a global financial revolution with reserve-backed tokens across blockchains, empowering businesses to integrate digital tokens seamlessly, securely, and globally.

What you will do

• Conduct pre-training AI models on large, distributed servers equipped with thousands of NVIDIA GPUs.
• Design, prototype, and scale innovative architectures to enhance model intelligence.
• Independently and collaboratively execute experiments, analyze results, and refine methodologies for optimal performance.
• Investigate, debug, and improve both model efficiency and computational performance.
• Contribute to the advancement of training systems to ensure seamless scalability and efficiency on target platforms.

Requirements

• A degree in Computer Science or related field.
• Hands-on experience contributing to large-scale LLM training runs on large, distributed servers equipped with thousands of NVIDIA GPUs.
• Familiarity and practical experience with large-scale, distributed training frameworks, libraries and tools.
• Deep knowledge of state-of-the-art transformer and non-transformer modifications aimed at enhancing intelligence, efficiency and scalability.
• Strong expertise in PyTorch and Hugging Face libraries with practical experience in model development, continual pretraining, and deployment.

Culture & Benefits

• Global talent powerhouse, working remotely from every corner of the world.
• Opportunity to collaborate with some of the brightest minds, pushing boundaries and setting new standards.
• Fast-growing and lean company, a leader in the industry.