LLM inference optimization: Architecture, KV cache and Flash attention

LLM inference optimization: Architecture, KV cache and Flash attention
Share:

Download MP3


Similar Tracks

Mixture of Experts: Mixtral 8x7B YanAITalk
On the Biology of a Large Language Model (Part 1) Yannic Kilcher
DeepSeek-V3 Gabriel Mongaras
Goodbye RAG - Smarter CAG w/ KV Cache Optimization Discover AI
Lecture 36: CUTLASS and Flash Attention 3 GPU MODE
Accelerating LLM Inference with vLLM (and SGLang) - Ion Stoica Nadav Timor
The case against SQL Theo - t3․gg
Visualizing transformers and attention | Talk for TNG Big Tech Day '24 Grant Sanderson
3D Gaussian Splatting! - Computerphile Computerphile
Llama 4 Explained: Architecture, Long Context, and Native Multimodality Julia Turc
LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU Umar Jamil
How FlashAttention Accelerates Generative AI Revolution Jia-Bin Huang
Finetuning Llama2 7B on Personal Dataset with an IITian | ML/LLM Project Mastering ML with Sreemanti
Mastering LLM Inference Optimization From Theory to Cost Effective Deployment: Mark Moyou AI Engineer
Exploring the Latency/Throughput & Cost Space for LLM Inference // Timothée Lacroix // CTO Mistral MLOps.community
How law firms targeted by Trump are responding to White House pressure | 60 Minutes 60 Minutes
Naomi Klein on Trump, Musk, Far Right & "End Times Fascism" Democracy Now!
Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ) Maarten Grootendorst
How to make LLMs fast: KV Caching, Speculative Decoding, and Multi-Query Attention | Cursor Team Lex Clips