[GH-ISSUE #404] Student Feedback - Chapter 11 #4027

New Issue

GiteaMirror · 2026-04-19T12:04:10-05:00

GiteaMirror commented

2026-04-19 12:04:10 -05:00

Originally created by @jasonjabbour on GitHub (Aug 27, 2024).
Original GitHub issue: https://github.com/harvard-edge/cs249r_book/issues/404

Originally assigned to: @jasonjabbour on GitHub.

Chapter 11 - Benchmarking AI

We felt like we walked away with all learning objectives except for the seventh.
This chapter was interesting because it tried to broach a large topic (benchmarking) by tackling specific cases. While this was helpful, it resulted in a lot of the text being repetitive, as the same ideas were being re-introduced with only slightly different contexts. Also, benchmarks have been mentioned/defined several times up until this point, normally to help explain benchmarks for the topic of each chapter. Because of these two things, we feel like this chapter might be unnecessary. Rather, you can build up the explanation of benchmarks in each chapter, giving relevant information on benchmarks while still sticking to the topic of the chapter. Readers would still walk away with understanding of benchmarks in specific capacities, altogether giving them a general idea of what benchmarks are.
Some repetition in explanation that we noticed were across 11.4.4 Training Benchmarks, Metrics section and 11.4.5 Inference Benchmarks, Metrics section. These ideas were generally the same, and explanations of the each metric in both places did not feel necessary. Also, in 11.4.4 Training Benchmarks, MLPerf Training Benchmark is explained twice (and each explanation has a paragraph dedicated to it).
This chapter was also long; a potential place to cut down on text could be 11.5.1 Historical Context. The background information is nice, but not strictly necessary.
We didn't understand Figure 11.5 (sorry!)
The 11.5.3 Lessons Learned section felt like more of a conclusion---perhaps it should go towards the end of the chapter, rather than the middle.
Figure 11.7 is right under the 11.7 The Trifecta heading, but does not demonstrate the trifecta. Perhaps switch out this image with something more relevant?
Machine Learning Systems - 11 Benchmarking AI.pdf

Originally posted by @sgiannuzzi39 in https://github.com/harvard-edge/cs249r_book/discussions/256#discussioncomment-9907601

Originally created by @jasonjabbour on GitHub (Aug 27, 2024). Original GitHub issue: https://github.com/harvard-edge/cs249r_book/issues/404 Originally assigned to: @jasonjabbour on GitHub. **Chapter 11 - Benchmarking AI** - We felt like we walked away with all learning objectives except for the seventh. - This chapter was interesting because it tried to broach a large topic (benchmarking) by tackling specific cases. While this was helpful, it resulted in a lot of the text being repetitive, as the same ideas were being re-introduced with only slightly different contexts. Also, benchmarks have been mentioned/defined several times up until this point, normally to help explain benchmarks for the topic of each chapter. Because of these two things, we feel like this chapter might be unnecessary. Rather, you can build up the explanation of benchmarks in each chapter, giving relevant information on benchmarks while still sticking to the topic of the chapter. Readers would still walk away with understanding of benchmarks in specific capacities, altogether giving them a general idea of what benchmarks are. - Some repetition in explanation that we noticed were across **11.4.4 Training Benchmarks**, Metrics section and **11.4.5 Inference Benchmarks**, Metrics section. These ideas were generally the same, and explanations of the each metric in both places did not feel necessary. Also, in **11.4.4 Training Benchmarks**, _MLPerf Training Benchmark_ is explained twice (and each explanation has a paragraph dedicated to it). - This chapter was also long; a potential place to cut down on text could be **11.5.1 Historical Context**. The background information is nice, but not strictly necessary. - We didn't understand _Figure 11.5_ (sorry!) - The **11.5.3 Lessons Learned** section felt like more of a conclusion---perhaps it should go towards the end of the chapter, rather than the middle. - _Figure 11.7_ is right under the **11.7 The Trifecta** heading, but does not demonstrate the trifecta. Perhaps switch out this image with something more relevant? [Machine Learning Systems - 11 Benchmarking AI.pdf](https://github.com/user-attachments/files/16034085/Machine.Learning.Systems.-.11.Benchmarking.AI.pdf) _Originally posted by @sgiannuzzi39 in https://github.com/harvard-edge/cs249r_book/discussions/256#discussioncomment-9907601_

GiteaMirror added the area: book type: improvement labels 2026-04-19 12:04:10 -05:00

GiteaMirror closed this issue

2026-04-19 12:04:11 -05:00

Sign in to join this conversation.

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/cs249r_book#4027