mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-11-17 16:04:28 -06:00
Closed
opened 2026-07-15 22:09:45 -05:00 by GiteaMirror
·
2 comments
No Branch/Tag Specified
dev
gh-pages
dependabot/npm_and_yarn/staffml/app/npm-security-fad8042812
dependabot/pip/binder/tools/dependencies/pip-security-a223a3ed80
dependabot/uv/mlperf-edu/uv-security-a223a3ed80
main
vol1/final-edit
review/vol4-visual-updates
labs-v0.1.1
slides-v0.1.1
tinytorch-v0.2.2
mlsysim-v0.3.1
staffml-v0.1.4
kits-v0.1.1
vol2-v0.3.1
vol1-v0.8.1
staffml-v0.1.3
staffml-v0.1.2
mlsysim-v0.3.0
tinytorch-v0.2.1
vol2-v0.3.0
vol1-v0.8.0
tinytorch-v0.2.0
tinytorch-v0.1.19
tinytorch-v0.1.18
tinytorch-v0.1.17
tinytorch-v0.1.16
tinytorch-v0.1.14
vol1-v0.7.2
vol1-camera-ready-2026-08-31
vol1-camera-ready-2026-08-11
instructors-v0.1.1
vol1-pr1957-merged
vol2-v0.2.1
vol1-v0.7.1
vol1-v0.7.0+vol2-v0.2.0
slides-v0.1.0
vol2-v0.2.0
vol1-v0.7.0
tinytorch-v0.1.13
mlsysim-v0.2.0
vol2-v0.1.2
vol1-v0.6.2
tinytorch-v0.1.12
vol2-v0.1.1
vol1-v0.6.1
mlsysim-v0.1.3
vol2-v0.1.0
vol1-v0.6.0
mlsysim-v0.1.2
staffml-v0.1.1
tinytorch-v0.1.11
labs-v0.1.0
kits-v0.1.0
slides-latest
instructors-v0.1.0
staffml-v0.1.0
mlsysim-v0.1.1
mlsysim-v0.1.0
tinytorch-v0.1.10
build-verified-windows-v1
tinytorch-v0.1.9
tinytorch-v0.1.8
mit-submission-v1
tinytorch-v0.1.7
tinytorch-v0.1.6
tinytorch-v0.1.5
tinytorch-slides-v0.1.0
tinytorch-v0.1.3
tinytorch-v0.1.4
tinytorch-v0.1.2
tinytorch-v0.1.1
tinytorch-v0.1.0
book-v0.5.1
tinytorch-audio-v0.1.1
tinytorch-audio-assets-v0.1
book-v0.5.0
book-v0.4.2
book-v0.4.1
book-v0.4.0
book-v0.3.0
book-v0.2.0
book-v0.1.0
Labels
Clear labels
area: book
area: collabs
area: kits
area: labs
area: socratiq
area: staffml
area: tinytorch
area: tools
area: website
bug
dependencies
format: epub
format: pdf
javascript
link-health
link-rot
priority-high
pull-request
staffml
type: bug
type: citation
type: code
type: errata
type: improvement
type: new
type: question
vault-sli
Mirrored from GitHub Pull Request
Milestone
No items
No Milestone
Projects
Clear projects
No projects
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/cs249r_book#34991
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @profvjreddi on GitHub (Jan 21, 2025).
Original GitHub issue: https://github.com/harvard-edge/cs249r_book/issues/636
Originally assigned to: @profvjreddi on GitHub.
Need to rewrite the training chapter. The original version that we have is more about general AI training with a few sprinkles of ML systems and instead I want to rewrite the chapter to really take an ML systems perspective on training.
@profvjreddi commented on GitHub (Jan 21, 2025):
Tentative draft will see how it comes out.
Chapter 8: AI Training
8.1 Introduction to AI Training
8.2 Data and Preprocessing for Training
8.3 Walkthrough: Training a Simple Network on MNIST
8.4 Training Workflows and Architectures
8.5 Training Optimizations from a System Perspective
8.5.1 Mixed Precision Training
8.5.2 Parallelism Strategies
8.5.3 Batch Size and Gradient Accumulation
8.5.4 Optimization Algorithms and System Trade-offs
8.5.5 Communication Overhead in Distributed Training
8.6 Bridging Algorithms to Hardware
8.6.1 Training Frameworks and Libraries
8.6.2 Exploiting Hardware-Specific Features
8.6.3 Profiling and Debugging System Performance
8.7 Case Studies: Training in Practice
8.7.1 Scaling MNIST at Scale
8.7.2 Training Large Language Models
8.7.3 Efficient Training for Computer Vision
8.8 Conclusion
8.8.1 Recap of Training as a System Process
8.8.2 Mitigating System Bottlenecks
8.8.3 Preparing for Scalable and Efficient ML Systems
@profvjreddi commented on GitHub (Jan 23, 2025):
I copied in some class notes and have been pushing those updates.