Research Engineer, Artificial General Intelligence (AI)

TL;DR

Research Engineer, Artificial General Intelligence (AI): Supporting the development of industry-leading multimodal large-language foundational models (LLMs) with an accent on novel algorithms and modeling techniques. Focus on scaling pre and post-training workflows, optimizing distributed training, and building efficient models on hyper-large GPU clusters.

Location: Candidates will be considered from US geographic markets, with specific mentions for Los Angeles County applicants.

Salary: $129,300–$223,600/year

Company

hirify.global is an Amazon team responsible for building industry-leading Generative AI Foundational Models.

What you will do

• Pre and post-train multimodal LLMs.
• Scale model training on hyper-large GPU and AWS Trainium clusters.
• Optimize training workflows using distributed training/parallelism techniques.
• Optimize low-level details of the training stack, including CUDA kernels and network I/O.
• Utilize, build, and extend industry-leading frameworks (NeMo, Megatron Core, PyTorch, Jax, vLLM, TRT).
• Investigate design approaches, prototype new technology, and evaluate technical feasibility.

Requirements

• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
• Experience programming with at least one software programming language.
• 2+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
• Hands-on experience and expertise in training Foundational Models/LLMs, and/or low-level optimization of ML training workflows, CUDA kernels, and network I/O.

Culture & Benefits

• Total compensation package including equity, sign-on payments, and a full range of medical, financial, and other benefits.
• Inclusive culture empowering Amazonians to deliver the best results for customers.
• Workplace accommodations or adjustments available for disabilities during the application and hiring process.