Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity
Share:

Download MP3


Similar Tracks

Feedback Transformers: Addressing Some Limitations of Transformers with Feedback Memory (Explained) Yannic Kilcher
Barret Zoph Switch Transformers: Scaling to Trillion Parameter Models w/ Simple & Efficient Sparsity KUIS AI
TRILLION Parameter Models Are Here Edan Meyer
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (Paper Explained) Yannic Kilcher
Stanford CS25: V1 I Mixture of Experts (MoE) paradigm and the Switch Transformer Stanford Online
LLMs | Mixture of Experts(MoE) - II | Lec 10.2 LCS2
TransGAN: Two Transformers Can Make One Strong GAN (Machine Learning Research Paper Explained) Yannic Kilcher
Visualizing transformers and attention | Talk for TNG Big Tech Day '24 Grant Sanderson
OpenAI CLIP: ConnectingText and Images (Paper Explained) Yannic Kilcher
Sparse Expert Models (Switch Transformers, GLAM, and more... w/ the Authors) Yannic Kilcher
Understanding Mixture of Experts Trelis Research
Big Bird: Transformers for Longer Sequences (Paper Explained) Yannic Kilcher
Transformers (how LLMs work) explained visually | DL5 3Blue1Brown
Attention in transformers, step-by-step | DL6 3Blue1Brown
The Most Important Algorithm in Machine Learning Artem Kirsanov
Pretrained Transformers as Universal Computation Engines (Machine Learning Research Paper Explained) Yannic Kilcher
George Hotz | Programming | Decision Transformer Reinforcement Learning (RL) | LunarLander | Part 1 george hotz archive
Decoder-Only Transformers, ChatGPTs specific Transformer, Clearly Explained!!! StatQuest with Josh Starmer
Paper deep dive: Evolutionary Optimization of Model Merging Recipes DataScienceCastnet
Sparse is Enough in Scaling Transformers (aka Terraformer) | ML Research Paper Explained Yannic Kilcher