168 Commits
Author SHA1 Message Date
Vijay Janapa Reddi 91e33f42e7 feat(socratiq): harden BYOK key validation, context carryover, and guide screenshots 2026-11-11 10:28:12 -05:00
Vijay Janapa Reddi f2f6e34214 feat(socratiq): add configurable selection clip, BYOK/OpenRouter PKCE SSO, and figure context
- Add configurable PopClip-style selection bar (Explain this, Ask, Check me, Taxonomy, Simplify, Example, Study tools) with gear menu and Learning preferences sync
- Add security-hardened BYOK and 1-Click OpenRouter OAuth PKCE SSO module (src_shared/byok-provider.js) with strict HTTPS host allowlist, secret redaction, session-only default storage, and shared .github.io origin protection
- Add Free shared model status bar and Connect your own Gemini / Claude controls in both Focused Reader and Study Tools
- Extract interactive figure explorer ([data-mlsys-explore]) control parameters in reader and study context extractors
- Update SocratiQ user guide prose and 2x HiDPI screenshots and add unit and Playwright regression coverage
2026-11-10 18:04:19 -05:00
Vijay Janapa Reddi 4b46fa985f Integrate ML Systems Taxonomy into SocratiQ and harden multi-viewport responsive UX
- Add socratiq/scripts/sync-taxonomy.mjs and generated socratiq/src_shared/taxonomy-map.js from taxonomy/framework-data.json
- Ground Focused Reader and Study Tools system prompts in the 5-Group ML Systems Taxonomy (F, S, P, Q, T) and active chapter subjects across Volumes I-IV
- Add 'Map to taxonomy' reader action, Taxonomy filter in + Context and @ mentions, and F/S/P/Q/T Knowledge Graph taxonomy alignment
- Harden responsive layouts across 320x568-1440x900 viewports (Light & Dark modes) including #tbl-socratiq-controls mobile wrapping, modal headers, and drawer sizing
- Add automated regression tests for chapter taxonomy resolution, reader taxonomy action, and + Context / @taxonomy mentions
2026-11-10 15:14:05 -05:00
Vijay Janapa Reddi 91be6e0c46 Harden SocratiQ context extraction, security, and AI Companion nav label
- Rename navigation entry to 'AI Companion (SocratiQ)' across Volumes I-IV (_quarto-html-vol{1..4}.yml, socratiq.qmd, and HTML integration tests)
- Reconstruct MathJax/KaTeX inline TeX in Study Tools text extraction while stripping mjx-assistive-mml and .chapter-concept-map noise
- Index MLSysBook foldbox callouts and closed <details> summary keywords in create_text_ref.js
- Expand Focused Reader captureParagraph to support list items, figure captions, and blockquotes inside <main>
- Bridge Focused Reader active passage into Study Tools + Context and @ mentions, add Escape close and documentElement theme sync
- Remediate DOM XSS sinks, hardcoded third-party API keys, runtime crash paths, Spaced Repetition bugs, listener leaks, and bundle minification
2026-11-10 10:38:14 -05:00
Vijay Janapa Reddi aadf7ba587 docs(socratiq): unify multi-volume brand palettes, refresh guide screenshots, and align prose with Classic Style 2026-11-09 08:36:54 +00:00
Vijay Janapa Reddi 5913985bfe Add SocratiQ AI disclaimer footnote and upgrade visual guide page 2026-11-08 14:50:16 +00:00
Vijay Janapa Reddi c7efbb7614 Stabilize quiz interaction and secure restored source navigation 2026-11-06 11:19:47 +00:00
Vijay Janapa Reddi df569af113 Activate SocratiQ gateway and refine guided learning across four volumes 2026-11-06 09:52:56 +00:00
Vijay Janapa Reddi 8e0d2895c7 Restore integrated SocratiQ study tools and harden reader workflows 2026-11-05 22:09:23 +00:00
Vijay Janapa Reddi fe248da8ae Merge dev into figure animation review 2026-11-05 19:56:22 +00:00
Vijay Janapa Reddi 1098ec6ec8 Improve original-art figure animations and audit trend plots across volumes 2026-11-05 19:51:40 +00:00
Vijay Janapa Reddi ec25a7e355 Improve SocratiQ learning workflows and repair study tools 2026-11-05 18:01:29 +00:00
Vijay Janapa Reddi 82757cc8d4 Merge dev into taxonomy branch for integration 2026-11-04 22:03:35 +01:00
Vijay Janapa Reddi 649d2954bb Refine taxonomy editorial workflow, presentation, and documentation 2026-11-04 22:03:03 +01:00
Vijay Janapa Reddi fdeb6d2362 Refresh Explore source bindings after chapter prose edits 2026-11-04 16:40:10 +01:00
Vijay Janapa Reddi 9af38de72f Standardize Explore animation layouts across volumes 2026-11-04 16:01:42 +01:00
Vijay Janapa Reddi 8ee3dda48d Sync animation layout pilot with local dev 2026-11-04 14:59:40 +01:00
Vijay Janapa Reddi 7a548c0f1e vol2/ch15: add audited frontier compute and pretraining energy figures with series provenance
Add reproducible Epoch AI frontier training compute (@fig-ai-compute-growth) and single-run pretraining energy (@fig-frontier-training-energy) figures to Volume II, Chapter 15, paired with builder-reported anchors at declared measurement boundaries, deterministic CSV extraction and manifest receipts, and structured provenance enforcement across book CSV series and figure cells.
2026-11-03 00:49:25 +02:00
Vijay Janapa Reddi 6aa93091b2 Add opt-in compact layout to the Explore player, piloted on five Vol1 figures
Compact mode (create({layout:'compact', intro})) orders the player as
title, intro, collapsed assumptions, diagram, control bar, narration.
The bar pins with a one-line step title only when it avoids the step's
focus and keep regions; a keyboard-reachable pill links to the narration
otherwise. Speed, Restart and the key legend move into a Speed popover.
Status words, step labels, view switches (Follow/Whole) and intros follow
new lints in check_original_player.py.

Pilots: mixed precision, overlapped fetching, activation checkpointing
(ch08); H100 roofline batching, tiling (ch11). Non-compact players are
unchanged.
2026-10-30 19:55:01 +02:00
Vijay Janapa Reddi 52178b6939 build(taxonomy): harden LinkML single source of truth, StaffML labels sync, and CI gates 2026-10-30 13:42:40 +02:00
Vijay Janapa Reddi 58a52b514a fix(socratiq): patch dompurify, vite, and katex advisories and rebuild the bundle
dompurify 3.4.17 closes the critical sanitizer advisory. The committed
bundle is rebuilt so the fix ships with it; old and new bundles both load
in headless Chromium with no errors. The low-severity katex advisory
remains in the copies pinned by mermaid and ink-mde.
2026-10-27 17:15:56 +01:00
Vijay Janapa Reddi 86b775eb96 socratiq: rebuild the bundle for the Groq model and markdown-it updates
Regenerated with npm run build:vite on Node 20, matching the bundle
drift check.
2026-10-27 07:17:18 +01:00
Vijay Janapa Reddi e5aacf79f2 Revert "socratiq: rebuild the bundle for the Groq model and markdown-it updates"
This reverts commit 5e580ae227.
2026-10-27 07:16:52 +01:00
Vijay Janapa Reddi 5e580ae227 socratiq: rebuild the bundle for the Groq model and markdown-it updates
Regenerated with npm run build:vite on Node 20, matching the bundle
drift check.
2026-10-27 07:16:25 +01:00
Vijay Janapa Reddi 3e480a3a96 deps: keep the build container installable after the security bumps
Pillow 13 and filelock 4.2 fix the open advisories but require Python
3.11, and the Ubuntu 22.04 build container runs Python 3.10, so the
Dependabot lock could not install there. requirements.txt now takes
Pillow 13 on Python 3.11+ and stays on 12.x below it, and the lock is
regenerated for 3.10 with existing pins kept.

gradio is removed. Nothing imports it, and every release caps Pillow
below 13, which made the CI dependency install fail outright.
2026-10-27 07:06:08 +01:00
dependabot[bot]andGitHub f252939fb4 Bump the uv-security group across 2 directories with 7 updates
Bumps the uv-security group with 3 updates in the /mlperf-edu directory: [black](https://github.com/psf/black), [pypdf](https://github.com/py-pdf/pypdf) and [certifi](https://github.com/certifi/python-certifi).
Bumps the uv-security group with 5 updates in the /binder/tools/dependencies directory:

| Package | From | To |
| --- | --- | --- |
| [certifi](https://github.com/certifi/python-certifi) | `2026.7.22` | `2026.10.18` |
| [filelock](https://github.com/tox-dev/py-filelock) | `4.1.0` | `4.2.1` |
| [pillow](https://github.com/python-pillow/Pillow) | `12.3.0` | `13.0.0` |
| [brotli](https://github.com/google/brotli) | `1.2.0` | `1.2.1` |
| [virtualenv](https://github.com/pypa/virtualenv) | `21.14.8` | `21.14.13` |



Updates `black` from 26.10.0 to 26.10.1
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](https://github.com/psf/black/compare/26.10.0...26.10.1)

Updates `pypdf` from 6.21.1 to 6.21.2
- [Release notes](https://github.com/py-pdf/pypdf/releases)
- [Changelog](https://github.com/py-pdf/pypdf/blob/main/CHANGELOG.md)
- [Commits](https://github.com/py-pdf/pypdf/compare/6.21.1...6.21.2)

Updates `certifi` from 2026.6.17 to 2026.10.18
- [Commits](https://github.com/certifi/python-certifi/compare/2026.06.17...2026.10.18)

Updates `certifi` from 2026.7.22 to 2026.10.18
- [Commits](https://github.com/certifi/python-certifi/compare/2026.06.17...2026.10.18)

Updates `filelock` from 4.1.0 to 4.2.1
- [Release notes](https://github.com/tox-dev/py-filelock/releases)
- [Changelog](https://github.com/tox-dev/filelock/blob/main/docs/changelog.rst)
- [Commits](https://github.com/tox-dev/py-filelock/compare/4.1.0...4.2.1)

Updates `pillow` from 12.3.0 to 13.0.0
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/12.3.0...13.0.0)

Updates `brotli` from 1.2.0 to 1.2.1
- [Release notes](https://github.com/google/brotli/releases)
- [Changelog](https://github.com/google/brotli/blob/go/brotli/v1.2.1/CHANGELOG.md)
- [Commits](https://github.com/google/brotli/compare/v1.2.0...go/brotli/v1.2.1)

Updates `virtualenv` from 21.14.8 to 21.14.13
- [Release notes](https://github.com/pypa/virtualenv/releases)
- [Changelog](https://github.com/pypa/virtualenv/blob/main/docs/changelog.rst)
- [Commits](https://github.com/pypa/virtualenv/compare/21.14.8...21.14.13)

---
updated-dependencies:
- dependency-name: black
  dependency-version: 26.10.1
  dependency-type: direct:production
  dependency-group: uv-security
- dependency-name: pypdf
  dependency-version: 6.21.2
  dependency-type: direct:production
  dependency-group: uv-security
- dependency-name: certifi
  dependency-version: 2026.10.18
  dependency-type: indirect
  dependency-group: uv-security
- dependency-name: certifi
  dependency-version: 2026.10.18
  dependency-type: direct:production
  dependency-group: uv-security
- dependency-name: filelock
  dependency-version: 4.2.1
  dependency-type: direct:production
  dependency-group: uv-security
- dependency-name: pillow
  dependency-version: 13.0.0
  dependency-type: direct:production
  dependency-group: uv-security
- dependency-name: brotli
  dependency-version: 1.2.1
  dependency-type: direct:production
  dependency-group: uv-security
- dependency-name: virtualenv
  dependency-version: 21.14.13
  dependency-type: direct:production
  dependency-group: uv-security
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-10-27 05:03:10 +00:00
Vijay Janapa Reddi 69abd6c3af refactor(figures): keep scaling plot CSVs local to chapters and scalar anchors in mlsysim 2026-10-22 13:29:04 +02:00
Vijay Janapa Reddi 9954af52b5 MLSysIM: separate host DRAM and accelerator HBM access latency, each sourced
The DRAM tech class carried 300 ns cited to Horowitz (2014), which reports
energy, not latency, and readers used it as HBM latency while the book's
host-memory figures say 100 ns. DRAM keeps the Horowitz energies;
HopperGlobalMemory holds Luo et al. (2024) Table IV, 478.8 cycles at
1,755 MHz (272.82 ns), and HostDram_Latency2009 holds Dean (2009), main
memory reference 100 ns. The drift auditor checks both.
2026-10-20 17:53:37 +02:00
Vijay Janapa Reddi 0534101d11 Integrate reviewed timing and arm animations across the book 2026-10-20 14:36:58 +02:00
Vijay Janapa Reddi 2aabe10ae3 Merge branch 'dev' into feat/original-figure-convolution 2026-10-20 14:02:27 +02:00
Vijay Janapa Reddi 459f726b5d Add playback speed and full-window animation views 2026-10-20 11:02:40 +02:00
Vijay Janapa Reddi ec6471316c Bring selected figures to life across all four volumes 2026-10-20 00:58:27 +02:00
Vijay Janapa Reddi 8d9d98ce76 Add verified raster artwork and keep animation controls beside figures 2026-10-19 23:31:57 +02:00
Vijay Janapa Reddi 85ee7368c2 Animate original memory diagrams across all four volumes 2026-10-19 21:30:18 +02:00
Vijay Janapa Reddi bf6baa040a Fix the 404 eyebrow in dark mode and let the audit check 404 pages
The 'Route not found' eyebrow stayed crimson at 2.3:1 on the dark page. The
audit now takes --base (the deployed path prefix) so 404 pages, which load
their assets by absolute path, can be served and judged instead of skipped, and
reports each failing element's class, region and colors.
2026-10-19 20:50:44 +02:00
Vijay Janapa Reddi 0b6813d56c Animate original textbook figures with shared playback and reviewed examples 2026-10-19 19:21:07 +02:00
Vijay Janapa Reddi 739a578a98 Merge dev into refactor/dark-cleanup
Dev rewrote the MLSys-im docs styles and now imports _ecosystem-base-dark, so
that file is kept (only _book-only-dark.scss stays removed). The shared
announcement, breadcrumb, code, caption and tab modules are layered on top of
the new MLSys-im dark file.
2026-10-19 18:18:04 +02:00
Vijay Janapa Reddi 16b7917612 Audit tool: run at phone width, check the banner and breadcrumb bar
Dispatch the toggle click so pages whose toggle is inside the collapsed navbar
are audited instead of skipped (every phone-width run before this skipped every
page). Add the announcement bar and the mobile breadcrumb bar to the regions
that must be dark, freeze transitions before measuring, and skip 404 pages,
which load their assets by deployed absolute path.
2026-10-19 18:17:03 +02:00
Vijay Janapa Reddi 3dac1031c7 Merge dev into figure work and preserve reviewed artifact provenance 2026-10-19 16:43:00 +02:00
Vijay Janapa Reddi efd1999a73 Refine figure explanations after full-section continuity review 2026-10-19 16:12:46 +02:00
Vijay Janapa Reddi b8c9d4539d audit_dark_mode: scan the whole page and check regions
Scan navbar, sidebar and footer, not just <main>, and require the page regions to be dark:
a white footer under dark text has fine contrast, so contrast alone cannot see it. Skip pages
whose colour-scheme toggle is not clickable instead of reporting an error.
2026-10-18 19:54:26 +02:00
Vijay Janapa Reddi eea7408ab8 Add selective step-controlled mechanisms across four volumes 2026-10-18 17:57:06 +02:00
Vijay Janapa Reddi 99cc75bfed Add and integrate reviewed static systems figures across four volumes 2026-10-18 15:18:04 +02:00
Vijay Janapa Reddi 5e012f2564 Add a WebKit dark-mode audit for built Quarto sites
Loads each page with the OS in light mode, clicks the colour-scheme toggle, and checks
contrast, callout headers, code blocks and section numbers. A Safari-only self-referencing
CSS variable made callout headers unreadable and passed every Chromium check.
2026-10-18 15:09:05 +02:00
Vijay Janapa Reddi f58ea55734 Merge branch 'feat/vol1-web-animations' into feat/figures-and-animation-pass
# Conflicts:
#	books/vol1/frontmatter/about.qmd
#	books/vol2/04_data_storage/04_data_storage.qmd
#	books/vol2/05_collective_communication/05_collective_communication.qmd
#	books/vol2/10_inference/10_inference.qmd
2026-10-18 14:42:56 +02:00
Vijay Janapa Reddi 8b2348432b Replace figure tours with selective mechanism animations 2026-10-17 18:42:19 +02:00
Vijay Janapa Reddi 6eb08beb60 fix(notation): retire unused registry macros, zero out .qmd raw-symbol baseline, and enforce notation-local coverage 2026-10-17 17:57:22 +02:00
Vijay Janapa Reddi 6451bf1484 Add chapter-integrated figure explorations across all four volumes 2026-10-17 13:37:22 +02:00
Vijay Janapa Reddi 1720c446eb build(container): install Python packages from an exact lockfile (py3.10) 2026-10-16 21:44:32 +02:00
Vijay Janapa Reddi d9c4236ac1 Merge remote-tracking branch 'origin/dev' into origin-pull-merge 2026-10-13 17:03:00 +02:00