1 Commits

Author SHA1 Message Date
Vijay Janapa Reddi
de46921cfe docs(vault-cli): PHASE_3_REVIEW_GUIDE.md — human review handoff
Walkthrough for reviewing LLM-authored question drafts produced by
generate_question_for_gap.py + validate_drafts.py. Covers:

  - what each of the 5 gates catches and (critically) misses
  - what to read in what order, with watchpoints for the failure modes
    that LLM gates routinely let through (vendor-name fabrication,
    arithmetic drift, level-stamping mismatches)
  - decision tree: promote (publish vs draft), edit + retry, reject
  - exact promote_drafts.py invocations for each path
  - rough scorecard summary for the 4 pilot drafts shipped in
    a750ab7bc, ready for the user's review pass

Designed for ~10-15 min of reading per pilot batch.
2026-05-01 17:24:07 -04:00