Episode 4: Implementing a PyTorch Trainer: PyTorch Lightning Trainer and callbacks under-the-hood

Similar Tracks
NVIDIA GTC '21: Half The Memory with Zero Code Changes: Sharded Training with Pytorch Lightning
Lightning AI
Thunder Sessions | Composable transforms to mix FSDP & DDP & nail memory vs communication trade-off
Lightning AI