Alpa: Automating Inter- and Intra- Operator Parallelism for Distributed Deep Learning

Alpa: Automating Inter- and Intra- Operator Parallelism for Distributed Deep Learning
Share:

Download MP3


Similar Tracks

Verified Tensor-Program Optimization Via High-Level Scheduling Rewrites | SAMPL Talk 2022/04/21 uwsampl
TensorIR: An Abstraction for Tensorized Program Optimization | SAMPL Talk 2022/01/20 uwsampl
OSDI '22 - Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning USENIX
How Fully Sharded Data Parallel (FSDP) works? Ahmed Taha
Alpa: Automated Model-Parallel Deep Learning - Zhuohan Li | Stanford MLSys #59 Stanford MLSys Seminars
Tackling the Communication Bottlenecks of Distributed Deep Learning Training Workloads uwsampl
Denzel Washington - University of Pennsylvania Vidbi
FULL| Beggar accidentally found a wooden stick, gained unimaginable power, and conquered the world! Fresh Drama +
Transformers (how LLMs work) explained visually | DL5 3Blue1Brown
Positive JAZZ - Morning Music To Start The Day Lounge Music
(Day 2 - Breakout Session) XLA FSDP OpenXLA
TVM Tutorial at FCRC [5/9]: SageMaker Neo uwsampl
University of Texas at Austin 2014 Commencement Address - Admiral William H. McRaven Texas Exes
Lofi hip hop mix - Beats to Relax/Study to [2018] Lofi Girl
UCLA NLP Seminar - Aditya Kusupati - Matryoshka Principles for Adaptive Intelligence uclanlp-plus
2-D Parallelism using DistributedTensor and PyTorch DistributedTensor PyTorch
NWDS Talk - Jianguo Wang - Database Systems for LLMs: Vector Databases and Beyond UW Database Group
Haomin Chen: Linear ballistic accumulator models of confidence and response time Complex Human Data Hub
Synthesizing Programmable Accelerators: A Compiler’s Perspective | SAMPL Talk 2022/01/27 uwsampl