Additions for Chapter 17.3 Energy Consumption #66

New Issue

GiteaMirror · 2026-03-22T15:24:12-05:00

GiteaMirror commented

2026-03-22 15:24:12 -05:00

Originally created by @jaywonchung on GitHub (Dec 16, 2023).

First of all, thanks for the great resource.

I'm part of a group of people working on ML energy optimization at UMich (https://ml.energy). To list a couple works:

Training

Zeus paper (NSDI ’23): Understanding the trade-off between training time and energy consumption and proposing an online optimization algorithm.
Zeus open-source: A generic DNN energy measurement and optimization framework.
Perseus: Energy reduction without slowdown for large model training. arXiv, open-source

Inference

ML.ENERGY leaderboard: The first public leaderboard on the energy consumption of LLM text generation.

Chapter 17.3 Energy Consumption does a very nice survey on efforts for energy estimation, measurement, and reporting. I'm thinking of adding a paragraph on energy optimization. Please let me know what you think.

Originally created by @jaywonchung on GitHub (Dec 16, 2023). First of all, thanks for the great resource. I'm part of a group of people working on ML energy optimization at UMich (https://ml.energy). To list a couple works: Training - [Zeus paper (NSDI ’23)](https://www.usenix.org/conference/nsdi23/presentation/you): Understanding the trade-off between training time and energy consumption and proposing an online optimization algorithm. - [Zeus open-source](https://ml.energy/zeus): A generic DNN energy measurement and optimization framework. - Perseus: Energy reduction without slowdown for large model training. [arXiv](https://arxiv.org/abs/2312.06902), [open-source](https://ml.energy/zeus/perseus) Inference - [ML.ENERGY leaderboard](https://ml.energy/leaderboard): The first public leaderboard on the energy consumption of LLM text generation. Chapter 17.3 Energy Consumption does a very nice survey on efforts for energy estimation, measurement, and reporting. I'm thinking of adding a paragraph on energy *optimization*. Please let me know what you think.

GiteaMirror added the area: book label 2026-03-22 15:24:12 -05:00

GiteaMirror closed this issue

2026-03-22 15:24:13 -05:00

GiteaMirror commented

2026-03-22 15:24:15 -05:00

@jaywonchung commented on GitHub (Dec 16, 2023):

Or I think having a new subsection (17.XX) dedicated for energy optimization would make sense, since I believe that ultimately one of the important goals of MLSys is to optimize energy consumption, going beyond estimation and reporting.

@jaywonchung commented on GitHub (Dec 16, 2023): Or I think having a new subsection (17.XX) dedicated for energy optimization would make sense, since I believe that ultimately one of the important goals of MLSys is to optimize energy consumption, going beyond estimation and reporting.

GiteaMirror commented

2026-03-22 15:24:16 -05:00

@profvjreddi commented on GitHub (Dec 16, 2023):

Hi @jaywonchung that's a great point, thanks for raising that. Please definitely go ahead and add a paragraph and in general it would be great to talk about the space broadly and of course we can include a reference to the point that Zeus is making.

Can you please draft what you have in mind and issue a PR? Would be happy to review it and make any edits and merge it in.

@profvjreddi commented on GitHub (Dec 16, 2023): Hi @jaywonchung that's a great point, thanks for raising that. Please definitely go ahead and add a paragraph and in general it would be great to talk about the space broadly and of course we can include a reference to the point that Zeus is making. Can you please draft what you have in mind and issue a PR? Would be happy to review it and make any edits and merge it in.

GiteaMirror commented

2026-03-22 15:24:16 -05:00

@profvjreddi commented on GitHub (Dec 16, 2023):

If you are interested, then create a branch off of this PR.

@profvjreddi commented on GitHub (Dec 16, 2023): If you are interested, then create a branch off of this PR.

GiteaMirror referenced this issue

2026-03-22 15:46:16 -05:00

[PR #66] [MERGED] add security and privacy chapter initial draft #573

GiteaMirror referenced this issue

2026-04-11 08:08:30 -05:00

[PR #66] [MERGED] add security and privacy chapter initial draft #1796

GiteaMirror referenced this issue