Week 10: Distributed Training & Capstone

7 lessons · Week 10 of 10

Lessons

• Day 64: Distributed Training Basics
• Day 65: Data Parallel & FSDP
• Day 66: Tensor & Pipeline Parallelism
• Day 67: Compiler's Role in Training
• Day 68: Capstone — Design
• Day 69: Capstone — Implementation
• Day 70: Capstone — Evaluation