mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-11-16 12:05:12 -06:00
Mlsysbook_chapter18_4_dropout #409
Closed
opened 2026-03-22 15:38:56 -05:00 by GiteaMirror
·
2 comments
No Branch/Tag Specified
dev
gh-pages
dependabot/pip/binder/tools/dependencies/pip-security-a223a3ed80
dependabot/uv/mlperf-edu/uv-security-a223a3ed80
main
vol1/final-edit
review/vol4-visual-updates
labs-v0.1.1
slides-v0.1.1
tinytorch-v0.2.2
mlsysim-v0.3.1
staffml-v0.1.4
kits-v0.1.1
vol2-v0.3.1
vol1-v0.8.1
staffml-v0.1.3
staffml-v0.1.2
mlsysim-v0.3.0
tinytorch-v0.2.1
vol2-v0.3.0
vol1-v0.8.0
tinytorch-v0.2.0
tinytorch-v0.1.19
tinytorch-v0.1.18
tinytorch-v0.1.17
tinytorch-v0.1.16
tinytorch-v0.1.14
vol1-v0.7.2
vol1-camera-ready-2026-08-31
vol1-camera-ready-2026-08-11
instructors-v0.1.1
vol1-pr1957-merged
vol2-v0.2.1
vol1-v0.7.1
vol1-v0.7.0+vol2-v0.2.0
slides-v0.1.0
vol2-v0.2.0
vol1-v0.7.0
tinytorch-v0.1.13
mlsysim-v0.2.0
vol2-v0.1.2
vol1-v0.6.2
tinytorch-v0.1.12
vol2-v0.1.1
vol1-v0.6.1
mlsysim-v0.1.3
vol2-v0.1.0
vol1-v0.6.0
mlsysim-v0.1.2
staffml-v0.1.1
tinytorch-v0.1.11
labs-v0.1.0
kits-v0.1.0
slides-latest
instructors-v0.1.0
staffml-v0.1.0
mlsysim-v0.1.1
mlsysim-v0.1.0
tinytorch-v0.1.10
build-verified-windows-v1
tinytorch-v0.1.9
tinytorch-v0.1.8
mit-submission-v1
tinytorch-v0.1.7
tinytorch-v0.1.6
tinytorch-v0.1.5
tinytorch-slides-v0.1.0
tinytorch-v0.1.3
tinytorch-v0.1.4
tinytorch-v0.1.2
tinytorch-v0.1.1
tinytorch-v0.1.0
book-v0.5.1
tinytorch-audio-v0.1.1
tinytorch-audio-assets-v0.1
book-v0.5.0
book-v0.4.2
book-v0.4.1
book-v0.4.0
book-v0.3.0
book-v0.2.0
book-v0.1.0
Labels
Clear labels
area: book
area: collabs
area: kits
area: labs
area: socratiq
area: staffml
area: tinytorch
area: tools
area: website
bug
dependencies
format: epub
format: pdf
javascript
link-health
link-rot
priority-high
pull-request
staffml
type: bug
type: citation
type: code
type: errata
type: improvement
type: new
type: question
vault-sli
Mirrored from GitHub Pull Request
Milestone
No items
No Milestone
Projects
Clear projects
No projects
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/cs249r_book#409
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @formlsysbookissue on GitHub (Jul 29, 2025).
Originally assigned to: @profvjreddi on GitHub.
As you mention, dropout is primarily used to prevent overfitting by deactivating neurons during training. While it can highlight areas of high uncertainty, it doesn’t directly estimate uncertainty. Perhaps combining dropout with Bayesian or ensemble methods could provide more robustness. Bayesian neural networks and ensemble methods offer more precise uncertainty estimates, though they are computationally expensive. In the meanwhile, I would like to suggest adding a brief mention of how the existing overfitting intervention mechanisms work in more detail.
@profvjreddi commented on GitHub (Jul 29, 2025):
Thanks for the feedback, will do! And by the way, you are welcome to issue a small PR too if you'd like, as I like to get the community to engage that way, and everyone who contributes is automatically recognised ;contrib. If not no worries, I will fix it. :-)
@profvjreddi commented on GitHub (Aug 15, 2025):
Thank you for your feedback 🙏
I updated the text as follows, and I hope that addresses your concern; it is all still a work in progress -- so thank you again for your time and feedback.