Week 9: LLM Serving Systems

7 lessons · Week 9 of 10

Lessons

• Day 57: LLM Inference Challenges
• Day 58: KV Cache Optimization
• Day 59: vLLM & PagedAttention
• Day 60: Speculative Decoding
• Day 61: LLM Quantization — GPTQ, AWQ, GGUF
• Day 62: Serving Frameworks Comparison
• Day 63: Stop & Reflect #5