mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-07-15 21:28:33 -05:00
_process_zip() ran `mlperf verify` as the only anti-cheat check, then caught FileNotFoundError and silently passed through to grading the submission's self-reported JSON metrics verbatim with "Cheating": "NO" -- meaning any environment without the mlperf CLI on PATH (the common case for a bare grading checkout) accepted hand-forged submissions with no verification at all. Reproduced: built a zip with forged metrics (accuracy 0.99, throughput 99999) and confirmed _process_zip() returned Status: VALIDATED, Cheating: NO. Now it returns Status: VERIFY_UNAVAILABLE, Cheating: UNVERIFIED and logs the failure instead of grading blind.