Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Share:

Download MP3


Similar Tracks

Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters (Paper) Yannic Kilcher
Sparse Expert Models (Switch Transformers, GLAM, and more... w/ the Authors) Yannic Kilcher
Google's Jeff Dean on the Coming Transformations in AI Sequoia Capital
Reformer: The Efficient Transformer Yannic Kilcher
Quantum Computing: Where We Are and Where We’re Headed | NVIDIA GTC 2025 Fireside Chat NVIDIA Developer
Feedback Transformers: Addressing Some Limitations of Transformers with Feedback Memory (Explained) Yannic Kilcher
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Paper Explained) Yannic Kilcher
OpenAI CLIP: ConnectingText and Images (Paper Explained) Yannic Kilcher
The Most Important Algorithm in Machine Learning Artem Kirsanov
NVIDIA CEO Jensen Huang's Vision for the Future Cleo Abram
Transformers (how LLMs work) explained visually | DL5 3Blue1Brown
MCP vs API: Simplifying AI Agent Integration with External Data IBM Technology
Biggest Puzzle in Computer Science: P vs. NP Quanta Magazine
The Most Useful Thing AI Has Ever Done Veritasium
Russell's Paradox - a simple explanation of a profound problem Jeffrey Kaplan
RAG vs. CAG: Solving Knowledge Gaps in AI Models IBM Technology
Big Bird: Transformers for Longer Sequences (Paper Explained) Yannic Kilcher
Rethinking Attention with Performers (Paper Explained) Yannic Kilcher
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote Snowflake Inc.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Yannic Kilcher