TL;DR

Research Engineer, Artificial General Intelligence (AI): Supporting the development of industry-leading multimodal large-language foundational models (LLMs) with an accent on novel algorithms and modeling techniques. Focus on scaling pre and post-training workflows, optimizing distributed training, and building efficient models on hyper-large GPU clusters.

Location: Candidates will be considered from US geographic markets, with specific mentions for Los Angeles County applicants.

Salary: $129,300–$223,600/year

Company

%hirify_global% is an Amazon team responsible for building industry-leading Generative AI Foundational Models.

What you will do

Pre and post-train multimodal LLMs.
Scale model training on hyper-large GPU and AWS Trainium clusters.
Optimize training workflows using distributed training/parallelism techniques.
Optimize low-level details of the training stack, including CUDA kernels and network I/O.
Utilize, build, and extend industry-leading frameworks (NeMo, Megatron Core, PyTorch, Jax, vLLM, TRT).
Investigate design approaches, prototype new technology, and evaluate technical feasibility.

Requirements

Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
Experience programming with at least one software programming language.
2+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience.
Hands-on experience and expertise in training Foundational Models/LLMs, and/or low-level optimization of ML training workflows, CUDA kernels, and network I/O.

Culture & Benefits

Total compensation package including equity, sign-on payments, and a full range of medical, financial, and other benefits.
Inclusive culture empowering Amazonians to deliver the best results for customers.
Workplace accommodations or adjustments available for disabilities during the application and hiring process.