AI Researcher (AI Architecture)

TL;DR

AI Researcher (AI Architecture): Designing and advancing next-generation model architectures with an accent on efficiency, scalability, and alternatives to standard Transformer designs. Focus on prototyping novel sequence models, conducting empirical studies, and publishing research papers in top ML conferences.

Location: Remote (World)

Company

AI research startup focused on developing next-generation model architectures and bridging the gap between theory and production.

What you will do

• Research and design novel AI architectures, including alternatives to Transformers, long-context models, and hybrid architectures.
• Explore architectural improvements to enhance model scalability, efficiency, and stability.
• Prototype and evaluate new architectures through ablations, benchmarks, and empirical studies.
• Author and co-author research papers for top ML conferences and journals.
• Collaborate with engineering teams to translate theoretical research into training and inference systems.

Requirements

• Strong background in machine learning research with a specific focus on model architecture.
• Proven publication record in top AI/ML venues such as NeurIPS, ICML, ICLR, COLM, ACL, EMNLP, or arXiv.
• Deep understanding of neural network architectures, sequence models, attention mechanisms, and training dynamics.
• Hands-on experience with PyTorch or JAX.
• Ability to design rigorous experiments and communicate results clearly.

Nice to have

• Experience with non-Transformer architectures (e.g., RNN-based, state-space, or hybrid models).
• Work on long-context or memory-efficient models.
• Open-source research contributions.
• Experience bridging research and production systems.
• Background in efficient training or inference-aware architecture design.

Culture & Benefits

• High ownership over research direction and the product roadmap.
• Clear path to publishing impactful work in the AI community.
• Tight feedback loop between research and real-world deployment.
• Small, highly technical team with a strong research culture.
• Competitive compensation and meaningful equity.