89 Commits
Author SHA1 Message Date
Vijay Janapa Reddi 91e33f42e7 feat(socratiq): harden BYOK key validation, context carryover, and guide screenshots 2026-11-11 10:28:12 -05:00
Vijay Janapa Reddi f2f6e34214 feat(socratiq): add configurable selection clip, BYOK/OpenRouter PKCE SSO, and figure context
- Add configurable PopClip-style selection bar (Explain this, Ask, Check me, Taxonomy, Simplify, Example, Study tools) with gear menu and Learning preferences sync
- Add security-hardened BYOK and 1-Click OpenRouter OAuth PKCE SSO module (src_shared/byok-provider.js) with strict HTTPS host allowlist, secret redaction, session-only default storage, and shared .github.io origin protection
- Add Free shared model status bar and Connect your own Gemini / Claude controls in both Focused Reader and Study Tools
- Extract interactive figure explorer ([data-mlsys-explore]) control parameters in reader and study context extractors
- Update SocratiQ user guide prose and 2x HiDPI screenshots and add unit and Playwright regression coverage
2026-11-10 18:04:19 -05:00
Vijay Janapa Reddi 4b46fa985f Integrate ML Systems Taxonomy into SocratiQ and harden multi-viewport responsive UX
- Add socratiq/scripts/sync-taxonomy.mjs and generated socratiq/src_shared/taxonomy-map.js from taxonomy/framework-data.json
- Ground Focused Reader and Study Tools system prompts in the 5-Group ML Systems Taxonomy (F, S, P, Q, T) and active chapter subjects across Volumes I-IV
- Add 'Map to taxonomy' reader action, Taxonomy filter in + Context and @ mentions, and F/S/P/Q/T Knowledge Graph taxonomy alignment
- Harden responsive layouts across 320x568-1440x900 viewports (Light & Dark modes) including #tbl-socratiq-controls mobile wrapping, modal headers, and drawer sizing
- Add automated regression tests for chapter taxonomy resolution, reader taxonomy action, and + Context / @taxonomy mentions
2026-11-10 15:14:05 -05:00
Vijay Janapa Reddi 91be6e0c46 Harden SocratiQ context extraction, security, and AI Companion nav label
- Rename navigation entry to 'AI Companion (SocratiQ)' across Volumes I-IV (_quarto-html-vol{1..4}.yml, socratiq.qmd, and HTML integration tests)
- Reconstruct MathJax/KaTeX inline TeX in Study Tools text extraction while stripping mjx-assistive-mml and .chapter-concept-map noise
- Index MLSysBook foldbox callouts and closed <details> summary keywords in create_text_ref.js
- Expand Focused Reader captureParagraph to support list items, figure captions, and blockquotes inside <main>
- Bridge Focused Reader active passage into Study Tools + Context and @ mentions, add Escape close and documentElement theme sync
- Remediate DOM XSS sinks, hardcoded third-party API keys, runtime crash paths, Spaced Repetition bugs, listener leaks, and bundle minification
2026-11-10 10:38:14 -05:00
Vijay Janapa Reddi aadf7ba587 docs(socratiq): unify multi-volume brand palettes, refresh guide screenshots, and align prose with Classic Style 2026-11-09 08:36:54 +00:00
Vijay Janapa Reddi 5913985bfe Add SocratiQ AI disclaimer footnote and upgrade visual guide page 2026-11-08 14:50:16 +00:00
Vijay Janapa Reddi c7efbb7614 Stabilize quiz interaction and secure restored source navigation 2026-11-06 11:19:47 +00:00
Vijay Janapa Reddi df569af113 Activate SocratiQ gateway and refine guided learning across four volumes 2026-11-06 09:52:56 +00:00
Vijay Janapa Reddi 8e0d2895c7 Restore integrated SocratiQ study tools and harden reader workflows 2026-11-05 22:09:23 +00:00
Vijay Janapa Reddi fe248da8ae Merge dev into figure animation review 2026-11-05 19:56:22 +00:00
Vijay Janapa Reddi 1098ec6ec8 Improve original-art figure animations and audit trend plots across volumes 2026-11-05 19:51:40 +00:00
Vijay Janapa Reddi ec25a7e355 Improve SocratiQ learning workflows and repair study tools 2026-11-05 18:01:29 +00:00
Vijay Janapa Reddi fdeb6d2362 Refresh Explore source bindings after chapter prose edits 2026-11-04 16:40:10 +01:00
Vijay Janapa Reddi 9af38de72f Standardize Explore animation layouts across volumes 2026-11-04 16:01:42 +01:00
Vijay Janapa Reddi 8ee3dda48d Sync animation layout pilot with local dev 2026-11-04 14:59:40 +01:00
Vijay Janapa Reddi 7a548c0f1e vol2/ch15: add audited frontier compute and pretraining energy figures with series provenance
Add reproducible Epoch AI frontier training compute (@fig-ai-compute-growth) and single-run pretraining energy (@fig-frontier-training-energy) figures to Volume II, Chapter 15, paired with builder-reported anchors at declared measurement boundaries, deterministic CSV extraction and manifest receipts, and structured provenance enforcement across book CSV series and figure cells.
2026-11-03 00:49:25 +02:00
Vijay Janapa Reddi 6aa93091b2 Add opt-in compact layout to the Explore player, piloted on five Vol1 figures
Compact mode (create({layout:'compact', intro})) orders the player as
title, intro, collapsed assumptions, diagram, control bar, narration.
The bar pins with a one-line step title only when it avoids the step's
focus and keep regions; a keyboard-reachable pill links to the narration
otherwise. Speed, Restart and the key legend move into a Speed popover.
Status words, step labels, view switches (Follow/Whole) and intros follow
new lints in check_original_player.py.

Pilots: mixed precision, overlapped fetching, activation checkpointing
(ch08); H100 roofline batching, tiling (ch11). Non-compact players are
unchanged.
2026-10-30 19:55:01 +02:00
Vijay Janapa Reddi 58a52b514a fix(socratiq): patch dompurify, vite, and katex advisories and rebuild the bundle
dompurify 3.4.17 closes the critical sanitizer advisory. The committed
bundle is rebuilt so the fix ships with it; old and new bundles both load
in headless Chromium with no errors. The low-severity katex advisory
remains in the copies pinned by mermaid and ink-mde.
2026-10-27 17:15:56 +01:00
Vijay Janapa Reddi 86b775eb96 socratiq: rebuild the bundle for the Groq model and markdown-it updates
Regenerated with npm run build:vite on Node 20, matching the bundle
drift check.
2026-10-27 07:17:18 +01:00
Vijay Janapa Reddi e5aacf79f2 Revert "socratiq: rebuild the bundle for the Groq model and markdown-it updates"
This reverts commit 5e580ae227.
2026-10-27 07:16:52 +01:00
Vijay Janapa Reddi 5e580ae227 socratiq: rebuild the bundle for the Groq model and markdown-it updates
Regenerated with npm run build:vite on Node 20, matching the bundle
drift check.
2026-10-27 07:16:25 +01:00
Vijay Janapa Reddi 0534101d11 Integrate reviewed timing and arm animations across the book 2026-10-20 14:36:58 +02:00
Vijay Janapa Reddi 459f726b5d Add playback speed and full-window animation views 2026-10-20 11:02:40 +02:00
Vijay Janapa Reddi ec6471316c Bring selected figures to life across all four volumes 2026-10-20 00:58:27 +02:00
Vijay Janapa Reddi 8d9d98ce76 Add verified raster artwork and keep animation controls beside figures 2026-10-19 23:31:57 +02:00
Vijay Janapa Reddi 85ee7368c2 Animate original memory diagrams across all four volumes 2026-10-19 21:30:18 +02:00
Vijay Janapa Reddi 0b6813d56c Animate original textbook figures with shared playback and reviewed examples 2026-10-19 19:21:07 +02:00
Vijay Janapa Reddi 3dac1031c7 Merge dev into figure work and preserve reviewed artifact provenance 2026-10-19 16:43:00 +02:00
Vijay Janapa Reddi efd1999a73 Refine figure explanations after full-section continuity review 2026-10-19 16:12:46 +02:00
Vijay Janapa Reddi eea7408ab8 Add selective step-controlled mechanisms across four volumes 2026-10-18 17:57:06 +02:00
Vijay Janapa Reddi 99cc75bfed Add and integrate reviewed static systems figures across four volumes 2026-10-18 15:18:04 +02:00
Vijay Janapa Reddi 8b2348432b Replace figure tours with selective mechanism animations 2026-10-17 18:42:19 +02:00
Vijay Janapa Reddi 6451bf1484 Add chapter-integrated figure explorations across all four volumes 2026-10-17 13:37:22 +02:00
Vijay Janapa Reddi d9c4236ac1 Merge remote-tracking branch 'origin/dev' into origin-pull-merge 2026-10-13 17:03:00 +02:00
Vijay Janapa ReddiandGitHub 4268ea4705 Merge pull request #2151 from harvard-edge/dependabot/npm_and_yarn/binder/tools/notation/npm-security-61e35e8f43
Bump the npm-security group across 5 directories with 3 updates
2026-10-13 15:00:46 +02:00
Vijay Janapa Reddi c1a8205fa3 vol4: replace ledger with plain words
Each use of ledger now names what the thing is: the scenario and coverage
tables of the data chapter, event timing tables, stopping and latency
budgets, trial and outcome logs, audit logs, test reports, and sets of
fault records. Labels, index keys, printed field names, concept maps, LEGO
class names, and figure text follow, and two chapter covers are relabeled.
Nearby inflated phrasing is plainer.
2026-10-13 14:16:56 +02:00
Vijay Janapa Reddi b3cf47e1b6 build(socratiq): rebuild bundle for the npm-security bumps
Regenerated with npm run build:vite on Node 20, matching the bundle-drift
check. Also absorbs earlier lockfile bumps that landed without a rebuild.
2026-10-13 14:07:46 +02:00
Vijay Janapa Reddi 9fb4f93c79 vol4: add Responsible Physical AI chapter
A new chapter 17, after Release, teaches who answers for the decisions
behind an admitted action, oversight a person can actually perform,
permission in stages, how a detection gap between groups of people
becomes a gap in impact energy, who bears risk without choosing it, data
about people, and the work the machine moves onto people. It opens on the
2023 Cruise collision. The approval record names who approved every
decision and blocks release when a name is missing. Privacy and incident
disclosure move in from Release, and worker burden from Frontier. The
fourth law is now named permission must be earned. The part opener,
roadmap, spine figure, dependency map, appendices, glossary, labs, and
concept maps follow the new order.
2026-10-13 13:33:07 +02:00
Vijay Janapa Reddi c4f5e21046 vol4: renumber Frontier from chapter 17 to 18
Makes room for the responsible physical AI chapter after Release. Pure
rename: the folder, chapter file, its -17- figure and table labels and
fig17_ image files move to 18, and configs, concept-map owners, the
structure table, lab links and figure tooling follow.
2026-10-13 12:01:26 +02:00
Vijay Janapa Reddi 40a27a1d50 vol1: rename ch03 ml_workflow to ml_lifecycle
Retitle the chapter ML Lifecycle and rename its folder, files, assets,
lab, slides, audit data, and instructor links, with redirects for the
old URLs. Section IDs keep the sec-ml-workflow prefix. Update the ch2
hand-off and the conclusion to name the lifecycle.
2026-10-10 19:40:22 +02:00
Vijay Janapa Reddi 811d8f227a vol1: rename ch02 ml_systems to system_paradigms; revise intro, notation, about
Rename the chapter folder, assets, lab, slides, audit data, and staffml
links from 02_ml_systems to 02_system_paradigms, with redirects for the
old URLs. Revise the introduction, notation, conventions, and about
pages, adding the frontmatter stack figures. Add park2024offloading.
2026-10-09 23:11:44 +02:00
Vijay Janapa Reddi c690b036d6 Clarify nervous system timing and admission contracts 2026-10-09 09:11:08 +02:00
Vijay Janapa Reddi 1fa4eb30d3 Merge branch 'dev' into fix/notation-vol2-4
# Conflicts:
#	books/references.bib
#	books/references.bib~HEAD
2026-10-01 17:34:47 -04:00
Vijay Janapa Reddi e85481c659 binder: checks for the defect classes found in the 2026-10-01 series pass
New scopes, each with a dated note at the check: headers blank-before
(headings and fenced divs folded into a paragraph lose their anchor) and
unnumbered-target; markup prose-leaks (LaTeX ties, $ closers glued to a
digit or an inline ref, caption-attribute escapes); refs callout-ref-noun
(custom callout refs print a bare number without their noun); notation
registry, vol1 print pin, and forms (now default; vol4 transpose rule);
pdf figure-font-floor (opt-in, printed-point measurement). inline-order gets
its own pre-commit hook so skipping book-check-code no longer hides it. The
notation-consistency bare-B rule ignores bold matrices. vol4 margin
generator: SPRT bounds and the p99 ladder label.
2026-10-01 17:34:29 -04:00
Vijay Janapa Reddi 8477ca9d78 Audit and authenticate all bibliography citations across repository
- Execute multi-tier live online verification across all 2,578 unique bibliography entries.
- Fix hallucinated and conflated entries in bibs/references.bib and mlperf-edu/paper/refs.bib.
- Replace broken and redirected URLs with authentic DOIs and canonical HTTPS URLs.
- Enrich bibs/canonical_provenance.json with 491 verified canonical records.
- Reseal bibs/manifest.json with updated cryptographic hashes.
- Add binder/tools/scripts/audit/comprehensive_live_bib_verifier.py with retry logic.
- Verify 100.0% clean pass on all binder check and pytest suites.
2026-10-01 12:31:00 -04:00
Vijay Janapa Reddi 8bad21c6c2 Consolidate bibliography subsystem into unified bibs directory
Relocate master bibliography (references.bib), cryptographic ledger
(manifest.json), curated external provenance (canonical_provenance.json),
and staging candidate inbox (inbox.bib) into unified bibs/ directory.

Maintain books/references.bib as git-tracked relative symlink to
../bibs/references.bib for seamless Quarto and compiler compatibility.
Update Binder CLI, verification engines, pre-commit guards, codespell
rules, and gateway test fixtures to point to bibs/ paths.
2026-10-01 11:09:08 -04:00
Vijay Janapa Reddi 9c0ce17938 feat(bib): authenticate and seal all master bibliography entries with SHA-256
- Run multi-tiered parallel verification engine against Crossref, DataCite, arXiv, OpenLibrary, standards registries, and authoritative web endpoints.
- Seal all 2,454 entries in books/references.bib into binder/tools/bib_verification_manifest.json with cryptographic SHA-256 hashes and authentic provenance.
- Harden binder check bib --scope verify to strictly require status: 'verified', an authentic external source, and a matching SHA-256 hash.
- Prune uncited duplicate and fabricated citations from references.bib and correct cadene2024lerobot repository metadata.
- Add canonical provenance registry and unit tests for hardened verification checks.
2026-10-01 07:18:15 -04:00
Vijay Janapa Reddi 674117c2e3 Unify Volume 1-4 bibliographies into demarcated master references.bib 2026-09-30 21:07:26 -04:00
Vijay Janapa Reddi 10b4b79950 vol4: close the open author decisions
- Ch13 deadline counts use Ch4's full response budget (blocking and
  interference allowances); the "upper limits" hedge is gone
- Blocking and interference allowances promoted to MLSysIM (AISLE), read by
  Ch4 and Ch13, listed in the data sheet (138 rows)
- Ch2 freshness worked example on the running machine's pick-station
  conveyor: median fits, the tail misses
- Ch5 transfer sections use the running machine; Cruise war story cut (Ch12
  owns it), orphaned figure and uncited bib entries removed
- Ch17 shield section kept as synthesis and tightened; its parent heading now
  names what the section argues

SKIP=book-check-bib-verify: the vol4 bib ledger is deferred citation work
(550 pre-existing unverified entries, none added by this commit).
2026-09-30 08:32:22 -06:00
Vijay Janapa Reddi 4f234a3052 vol4: independent sign-off fixes
- Ch4 winding time constant from the registry (2.7 ms, was hand-typed 0.5 ms)
- tau_delay defined as the pre-brake delay excluding delta_da in Ch1, Ch2 and
  appendix_control; operator MAC is AES-128 CMAC in Ch14 and appendix_systems
- Ch4 handoff grid matches the intent model's 336 ms at 2 Hz
- Ch8 wrist-camera exposure from the registry (5 ms); Ch9 40 ms named as the
  chunk-policy inference pass; unsourced percentages reworded
- Unrated checks no longer called certified (Ch11, Ch12)
- Remaining hand-typed values to LEGO; MLSysIM insulation class F limit
- LOs aligned with body (Ch14 LO3); S.P.A glossed at first use
- Margin generator: handshake strip status ready (preface swapped it out)
2026-09-30 00:00:06 -06:00