mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-07-15 21:28:33 -05:00
[PR #1932] [MERGED] fix(mlperf-edu): remove vacuous deterministic-seed check from quick_check_model #34656
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/harvard-edge/cs249r_book/pull/1932
Author: @Shashank-Tripathi-07
Created: 7/7/2026
Status: ✅ Merged
Merged: 7/10/2026
Merged by: @profvjreddi
Base:
dev← Head:fix/compliance-quick-check-vacuous-seed-check📝 Commits (1)
3949a87fix(mlperf-edu): remove vacuous deterministic-seed check from quick_check_model📊 Changes
1 file changed (+0 additions, -1 deletions)
View changed files
📝
mlperf-edu/scripts/compliance_checker.py(+0 -1)📄 Description
Summary
quick_check_model()only instantiates a fresh reference model to sanity-check parameter counts and dataset loading; no training run ever happens and no seed is read anywhere in this path.check_deterministic_seed(result)was called with noseedargument, so it always compared the hardcoded default (42) against itself and passed unconditionally, regardless of whether a real run used any particular seed.check_from_log()already performs this check correctly elsewhere by reading the real seed out of the training log (log.get("seed", -1)), so this call inquick_check_model()was pure dead weight that could only ever report a false PASS.Test plan
check_deterministic_seed(seed: int = 42)comparesseed == 42; the only other call site (check_from_log) passes the real seed, so removing the argument-less call inquick_check_model()does not affect any real seed verification.grepconfirms no remaining calls tocheck_deterministic_seedwithout an explicit seed argument.🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.