Member Of Technical Staff, Frontiers Of Deep Learning Scaling (AI)

TL;DR

Member of Technical Staff, Frontiers of Deep Learning Scaling (AI): Exploring methods to effectively scale up intelligence by scaling up compute for large language models with an accent on data cleaning and discovering new knowledge via self-improvement. Focus on large-scale, long-time training runs, ensuring models improve stably, and innovating new model architectures and learning paradigms.

Location: Must be located near the Bay Area or open to relocation

Salary: $180,000 - $440,000 USD

Company

hirify.global’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge.

What you will do

• Explore and define "effective compute" and "useful data" for scaling intelligence.
• Develop new knowledge via self-improvement methods.
• Design and implement new learning paradigms like continual learning.
• Create unified models for text, code, images, and video understanding and generation.
• Innovate new model architectures, attention mechanisms, and non-autoregressive models.
• Address training stability issues for large-scale and long-time training runs.

Requirements

• Proficiency in Python, JAX, PyTorch, and Rust.
• Experience with data cleaning and preparation.
• Strong collaboration and communication skills.
• Must be located near the Bay Area or open to relocation

Culture & Benefits

• Flat organizational structure with hands-on contributions expected from all members.
• Equity, comprehensive medical, vision, and dental coverage.
• Access to a 401(k) retirement plan.
• Short & long-term disability insurance and life insurance.
• Various other discounts and perks.