144 Commits
Author SHA1 Message Date
Vijay Janapa Reddi 91be6e0c46 Harden SocratiQ context extraction, security, and AI Companion nav label
- Rename navigation entry to 'AI Companion (SocratiQ)' across Volumes I-IV (_quarto-html-vol{1..4}.yml, socratiq.qmd, and HTML integration tests)
- Reconstruct MathJax/KaTeX inline TeX in Study Tools text extraction while stripping mjx-assistive-mml and .chapter-concept-map noise
- Index MLSysBook foldbox callouts and closed <details> summary keywords in create_text_ref.js
- Expand Focused Reader captureParagraph to support list items, figure captions, and blockquotes inside <main>
- Bridge Focused Reader active passage into Study Tools + Context and @ mentions, add Escape close and documentElement theme sync
- Remediate DOM XSS sinks, hardcoded third-party API keys, runtime crash paths, Spaced Repetition bugs, listener leaks, and bundle minification
2026-11-10 10:38:14 -05:00
Vijay Janapa Reddi 1526424931 fix(book): bind reviewed interactive artwork to versioned SVG assets 2026-11-07 07:14:30 +00:00
Vijay Janapa Reddi b5d5341a85 Integrate SocratiQ guides across all volume previews 2026-11-06 17:35:30 +00:00
Vijay Janapa Reddi df569af113 Activate SocratiQ gateway and refine guided learning across four volumes 2026-11-06 09:52:56 +00:00
Vijay Janapa Reddi 44a28da0d9 Merge dev into figure consolidation before integration 2026-11-06 08:00:25 +00:00
Vijay Janapa Reddi 0542792d40 Correct figure evidence and narrative across four volumes 2026-11-06 07:56:00 +00:00
Vijay Janapa Reddi 8e0d2895c7 Restore integrated SocratiQ study tools and harden reader workflows 2026-11-05 22:09:23 +00:00
Vijay Janapa Reddi fe248da8ae Merge dev into figure animation review 2026-11-05 19:56:22 +00:00
Vijay Janapa Reddi 1098ec6ec8 Improve original-art figure animations and audit trend plots across volumes 2026-11-05 19:51:40 +00:00
Vijay Janapa Reddi ab4e2d7db5 Restore contextual SocratiQ reading assistance across four volumes 2026-11-05 17:32:25 +00:00
Vijay Janapa Reddi 4219592f17 Install PDF text extraction tooling before host verification 2026-11-05 06:09:06 +01:00
Vijay Janapa Reddi faef3f2c0a Preserve PDF typography and verify authoritative LaTeX diagnostics 2026-11-05 05:06:18 +01:00
Vijay Janapa Reddi 4b019474b0 Make PDF freshness fixtures independent of filesystem clock resolution 2026-11-05 04:29:38 +01:00
Vijay Janapa Reddi 6d78bcdc16 Export publisher figure metadata from current AUX labels 2026-11-05 04:05:42 +01:00
Vijay Janapa Reddi 40dd715ae6 Verify PDF artifacts and preserve content during compression 2026-11-05 03:24:19 +01:00
Vijay Janapa Reddi e69b52addd Preserve include paths and provenance in generated volume entry points 2026-11-05 01:50:30 +01:00
Vijay Janapa Reddi 82757cc8d4 Merge dev into taxonomy branch for integration 2026-11-04 22:03:35 +01:00
Vijay Janapa Reddi 649d2954bb Refine taxonomy editorial workflow, presentation, and documentation 2026-11-04 22:03:03 +01:00
Vijay Janapa Reddi b0160ece29 Strengthen and organize MLSysIM modeling engine 2026-11-04 21:29:54 +01:00
Vijay Janapa Reddi 6625fbf6c2 Harden taxonomy governance validators, CI checks, and Bucket A receipts 2026-11-04 01:21:46 +02:00
Vijay Janapa Reddi fedbb4c8f0 Complete taxonomy provenance replay, Seatbelt R2 refresh, and v3 burn ledger 2026-11-03 15:31:46 +02:00
Vijay Janapa Reddi 6682e03742 Harden taxonomy provenance replay, execution receipts, and governance charter 2026-11-03 09:08:21 +02:00
Vijay Janapa Reddi 5d51744cf9 Harden taxonomy refresh provenance gates and align study receipts 2026-11-03 04:19:52 +02:00
Vijay Janapa Reddi 49574db8eb Harden taxonomy refresh provenance, workspace isolation, and Phase 7 audit receipts 2026-11-03 01:42:41 +02:00
Vijay Janapa Reddi f1fd3c5263 taxonomy: remediate 3-org Run 5 audit blockers and add term-provenance sidecar 2026-11-03 00:16:46 +02:00
Vijay Janapa Reddi cab90676fb fix(taxonomy): harden refresh gates, audit receipts, and upward-posted aliases 2026-11-02 23:12:36 +02:00
Vijay Janapa Reddi 284b2964a2 taxonomy: adopt Z39.19 and SKOS as the stated construction and representation standards
METHOD.md marks each applicable clause met, partial, or open, including the
departures: no expert committee, no human indexing trial, and model-assisted
decisions the standard assumes people make.

- Two audits applied the all-and-some test to 127 specializes edges; the 27
  both failed are retyped or removed, and specializes now exports as
  skos:broader while part-of stays associative under Z39.19 8.3.3.2
- Compiler enforces SKOS S27; tests validate the export
- Concepts record added_in and computed warrant counts
- Release adds an OWL relations vocabulary, DCAT metadata, CITATION.cff,
  scope notes, and redirect pages for identifiers
- Agreement reports Hooper and Rolling consistency
2026-11-02 14:21:39 +02:00
Vijay Janapa Reddi cec2230543 Add taxonomy usage dropdown and deduplicate taxonomy compiler and frontend 2026-11-01 10:15:51 +02:00
Vijay Janapa Reddi 532e793fb2 fix(taxonomy): resolve red-team and anti-reward-hack audit findings across schema, CI, and consumers 2026-10-31 23:16:49 +02:00
Vijay Janapa Reddi ae25ccccbd feat(taxonomy): enforce end-to-end LinkML single source of truth across Binder, StaffML, and site 2026-10-30 19:05:39 +02:00
Vijay Janapa Reddi 6d91373366 refactor(taxonomy): remove legacy split-file fallbacks and document single source of truth 2026-10-30 15:15:19 +02:00
Vijay Janapa Reddi 2288cf53bb feat(taxonomy): unify authored taxonomy into single canonical ml-systems-taxonomy.yml 2026-10-30 14:42:49 +02:00
Vijay Janapa Reddi 52178b6939 build(taxonomy): harden LinkML single source of truth, StaffML labels sync, and CI gates 2026-10-30 13:42:40 +02:00
Vijay Janapa Reddi 0de606c2c4 fix(taxonomy): enforce anti-reward-hacking rules and validate release JSON against LinkML schema 2026-10-30 08:42:57 +01:00
Vijay Janapa Reddi 68ea73f4c8 feat(taxonomy): port metamodel validation to LinkML and show Concept map first 2026-10-29 19:10:10 +01:00
Vijay Janapa Reddi 983e7649e2 Consolidate ML Systems Taxonomy into root taxonomy/ directory 2026-10-28 08:02:35 +01:00
Vijay Janapa Reddi 856324d69c Taxonomy compiler: reader guides, validated against the graph
Roles, production symptoms, and learning paths load from
shared/concepts/ml-systems-guides.yml. Every subject and concept must
exist, and every symptom check and lever must share a relationship with
one of the symptom's causes.
2026-10-28 07:38:22 +01:00
Vijay Janapa Reddi 50edc4d1d1 Merge branch 'fix/staffml-hardware-from-mlsysim' into dev
# Conflicts:
#	staffml/app/src/data/mlsys-taxonomy.json
2026-10-27 22:58:37 +01:00
Vijay Janapa Reddi 40d58ce0cf Taxonomy compiler: reject comma-split keys, enforce graph invariants, and sync coverage subjects
- Repair 16 unquoted YAML flow-mapping comma splits (key: null) across 6 sources and 9 relationships in ml-systems-field.yml and 1 source in ml-systems-framework.yml that truncated published scope, predicate, conditions, and role strings.
- Remove 2 case-insensitive duplicate aliases within the same concept (mlsys.matrix-unit and mlsys.kv-cache-eviction).
- Update 13 covered topics in courses-and-standards-2026.yml and mlsys-papers-2025-2026.yml whose subject field disagreed with the home of their cited concepts.
- Harden field_graph.py, framework.py, taxonomy_coverage.py, and taxonomy_agreement.py (with regression tests) to reject unknown keys, within-concept duplicate aliases, concepts with fewer than two relationships, disconnected concept graphs, and covered checklist topics whose subject disagrees with their concept homes.
2026-10-27 22:35:42 +01:00
Vijay Janapa Reddi 6e135fe487 Taxonomy release: publish declared gaps and concept book passages
The JSON download omitted the declared gaps shown on the page, and
concept records carried no pointer into the books, so a researcher or
instructor working from the download could not see either. JSON now
includes gaps (with subject code) and each concept's book_passages; the
concepts CSV gains a taught_in column.
2026-10-27 21:28:41 +01:00
Vijay Janapa Reddi ce5aa5fc3a Taxonomy: a label or alias must name exactly one concept
Five names each resolved to two concepts, so a glossary lookup or a
tagger could land on either. The dedicated concept keeps the name:
Pareto frontier, SIL (safety integrity level), model export, data
loader (host-side loading), app memory limit (on-device budget). The
compiler now rejects a label or alias, case- and space-insensitive,
shared by two concepts.
2026-10-27 21:17:51 +01:00
Vijay Janapa Reddi f76817c904 Taxonomy: resolve chapter pointers only to folders that hold their QMD
A leftover build-output folder (books/vol1/02_ml_systems/, untracked HTML)
beside the renamed 02_system_paradigms/ made v1/02 ambiguous, so
concepts build and check failed in the main checkout. Count a folder as a
chapter only when it contains <folder>.qmd, and add a regression test.
2026-10-27 21:06:54 +01:00
Vijay Janapa Reddi 3a158cacbc site: serve the ML Systems Taxonomy at /taxonomy/ and retire /explore/
The page moves from site/explore/ to site/taxonomy/, matching its title,
its nav label, and the identifier namespace the taxonomy already used.
/explore/ keeps unlisted noindex redirect stubs, with relative targets
so they resolve on both the live site and the dev preview subpath.

The binder now holds the folder and the public address in one place
(concept_graph.SITE_DIR and PAGE_URL), and the generated page data carries
the address so the on-page citation reads it instead of repeating it.
The dev preview rewrites links inside taxonomy/ like the other subsites.
2026-10-27 05:45:54 +01:00
Vijay Janapa Reddi c45d4e2fea refactor(slides,mlsysim): inline slide numbers.tex macros and prune slide-only mlsysim bloat 2026-10-23 07:44:36 +02:00
Vijay Janapa Reddi afce08afe7 Taxonomy: write the framework without YAML aliases and refuse them
A merge script that reused list objects emitted 30 anchors into
ml-systems-framework.yml, which StaffML's hardened loader rejects. Rewrite
the file in full (same data) and make the concepts build fail on aliases.
2026-10-22 14:26:49 +02:00
Vijay Janapa Reddi 701402cf9f Merge dev into concept-explorer for retire 2026-10-22 13:57:26 +02:00
Vijay Janapa Reddi 314db150aa Record tagging agreement and recompute it with binder concepts agreement
Subject agreement 78.7% (kappa 0.78) under the first rules and 83.7%
(kappa 0.83) after revising them on the same sample, which the record
marks as no longer held out.
2026-10-22 13:55:35 +02:00
Vijay Janapa Reddi 821ae599d3 Compile the ML systems taxonomy: codes, relations, releases, coverage
The framework compiler now accepts a groups tier and nested readable codes
(L4.4), resolves chapter pointers to titles and clean published URLs, and
rejects scope notes that cite a row or area that does not exist. The field
compiler enforces a controlled relation vocabulary, rejects duplicate concept
pairs, and keeps retired concept identities pointing at a replacement.

Each build writes public downloads (CSV, JSON, SKOS Turtle, GraphML, BibTeX)
to site/explore/downloads. `binder concepts coverage` scores recorded
checklists and fails when a judgment cites a concept that no longer exists.

Chapter URLs now use the flattened published form (/volN/<chapter>/...).
2026-10-22 12:30:40 +02:00
Vijay Janapa Reddi 1f9af17810 Add cross-volume concept explorer and coverage audit pipeline 2026-10-21 15:50:05 +02:00
Vijay Janapa Reddi 0fa110790c Complete animation audit and repair playback clarity
Clarify pending results in legacy controllers, fix manual convolution pause and speed handling, and keep im2col contributions readable on narrow screens.

Refresh source fingerprints and hash-bound reviews for the 100 selected animations across all four volumes. Support explicit per-volume catalog build roots so reviewed links cannot fall back to stale outputs.

Validation: four-volume HTML build plus final Volume I rebuild; 79 tests; 800 Chromium/WebKit viewport and theme profiles; per-volume mechanism and rendered-state reviews.
2026-10-20 17:04:46 +02:00