110 Commits

Author SHA1 Message Date
Vijay Janapa Reddi
bcd5483813 docs(tinytorch): refresh release narrative 2026-06-02 13:39:45 -04:00
Vijay Janapa Reddi
54ef0ae7be chore: apply bib-tidy auto-formatting
Pre-commit hook formatting fixes applied to bib files brought in from the
dev merge. Whitespace/field-order only; no semantic changes.
2026-05-20 11:22:02 -07:00
Vijay Janapa Reddi
c3921491e8 chore(bib): fix paper-subproject wrong-paper keys and corrupt entries
Round 2 of the bib audit, covering paper subprojects (mlsysim,
tinytorch, periodic-table, mlperf-edu) that the textbook-focused first
pass deferred. Same pattern as round 1: surname/year prefixes did not
match the entry's actual paper, plus several corrupt entries from
Crossref misidentification.

Renames:
- mlsysim/{docs,paper}: barrett2024 -> zheng2024sglang (SGLang paper,
  Zheng is first author).
- mlsysim/paper: zhao2025 -> deepseek2025v3 (DeepSeek-V3 ISCA paper,
  corporate author DeepSeek-AI).
- tinytorch: key499f5624 -> tanenbaum1987os (hash-fallback for
  Tanenbaum OS textbook); fry1985 -> abelson1996sicp (SICP 2nd ed,
  Fry is not in author list); wooster1982 -> papert1980mindstorms
  (Mindstorms by Papert, Wooster not in author list); collins2018 ->
  collins1989apprenticeship (Cognitive Apprenticeship paper is 1989).
- tinytorch + periodic-table: vaswani2025 -> vaswani2017attention
  (Attention paper is 2017; entries had a corrupt publisher and bogus
  DOI from Crossref misidentification).

Body fixes accompanying renames:
- tanenbaum1987os, abelson1996sicp, papert1980mindstorms: rebuilt as
  @book entries (were @article with stale review/journal DOIs).
- vaswani2017attention: rebuilt with canonical NeurIPS 2017 metadata
  (Curran Associates, vol 30, pp 5998-6008); dropped corrupt DOI.

Orphan deletions:
- tinytorch keybe9561f4 (hash-fallback, no cite sites).
- mlperf-edu vaswani2017attention (orphan).

21 cite-site updates across 4 paper subprojects. bib_lint reports 0
errors across all 5 modified bibs.
2026-05-05 20:21:04 -04:00
Vijay Janapa Reddi
5f94bf3b20 chore: complete bib sweep and fix three citation bugs
Wraps up the bib-verify sweep across vol1, vol2, and the paper sub-projects,
and corrects three citation issues introduced earlier in the branch:

- Restore tang20211bit (1-bit Adam, Tang et al. ICML 2021) in vol2 bib and
  in collective_communication.qmd. The earlier sweep had renamed the cite
  to li2022, which now resolved to AlphaCode or 1-Bit LAMB.
- Restore micikevicius2018mixed in vol1 bib to point at "Mixed Precision
  Training" (Micikevicius et al. ICLR 2018). The entry had been overwritten
  with an unrelated OpenSeq2Seq paper while the cite key stayed the same.
- Drop the unused li2022 (AlphaCode) entry and the duplicate li2022 (1-Bit
  LAMB) entry from vol2 bib.

Also remove eight same-paper duplicate entries that the sweep had left
behind (vol1: lawson1979, gholami2022, lange2009, ribeiro2016; vol2:
bursztein2024, rasley2020, sevilla2022, narayanan2019).

After this commit the bibs have zero duplicate keys and zero orphan
citations across both volumes and all five paper sub-projects.
2026-05-04 21:22:07 -04:00
Vijay Janapa Reddi
ba2942f4f8 chore: sweep bibs to MIT Press expectations 2026-05-04 13:24:23 -04:00
Vijay Janapa Reddi
de776df481 build: add pre-commit hook to prevent LEGO dead code 2026-05-03 15:38:48 -04:00
Vijay Janapa Reddi
145f589916 fix(refs): orphan triage round 3 — delete 2 out-of-scope paper-bib entries
Deleted reddi2024mlsysbook from tinytorch/paper and rafailov2023direct from
periodic-table/paper. Both were identified as true orphans (not cited in
any .qmd or .tex) and out of scope for their respective papers.
2026-05-03 15:26:58 -04:00
Vijay Janapa Reddi
a37340aefe feat(refs): scan paper.tex citations in cross-repo integrity check
The previous scope was .qmd only, which made every paper-bib entry not
cited from a chapter look orphan even when paper.tex cited it. Adds
\cite/\citep/\citet/\citeauthor/\citeyear pattern matching for the four
paper.tex files (interviews, tinytorch, periodic-table, mlsysim).

Also fixes 6 broken links in tinytorch/paper/paper.tex caused by earlier
bib-audit deletions of keys that had year/surname mismatches. Restored
these entries with corrected keys (appel2002tiger, reddi2021widening,
pfaff2009pintos, rush2020minitorch, zhang2023dive) and updated the .tex
file to match. Replaced kannan2022astrasim with won2023astrasim2.
2026-05-03 15:26:05 -04:00
Vijay Janapa Reddi
046c832534 fix(refs): round 2 — 66 more bib audit fixes (catastrophic + cleanup) 2026-05-03 13:36:51 -04:00
Vijay Janapa Reddi
a2fe5b0cb0 fix(refs): apply 54 bib audit fixes from verification pass 2026-05-03 13:15:53 -04:00
Vijay Janapa Reddi
0289cdd561 fix(bib): restore auxiliary bib files affected by title-mangling
Same regression as vol1/vol2 references.bib (commit 42bc54275 figure-audit
feat) — five auxiliary bib files (interviews/paper, mlsysim/docs,
mlsysim/paper, periodic-table/paper, tinytorch/paper) had brace patterns
mangled in titles, e.g. 'Throughput-Latency Tradeoff in {LLM} Inference'
became 'Throughput-Latency Tradeoff in {LLM}} Inference', which
bibtex-tidy refuses to parse.

Restored to the parent of 42bc54275 (state at 9ebdf77d0) and
re-formatted via the bib_apply_mechanical + bibtex-tidy hooks.
2026-04-27 15:14:55 -04:00
Vijay Janapa Reddi
42bc54275d feat: add multimodal figure audit automation script and README 2026-04-27 13:35:48 -04:00
Vijay Janapa Reddi
9ebdf77d0a Commit on references 2026-04-27 13:21:16 -04:00
Vijay Janapa Reddi
1eb30f5f86 fix(mlsysim): harden release QA and paper artifacts
Align the MLSys·im code, docs, paper, website, workflows, and lab wheel for the 0.1.1 release. This also fixes runtime/API issues found during release review and prepares the paper PDF plus archive package.
2026-04-25 10:06:01 -04:00
Vijay Janapa Reddi
9ade073984 pass 17 bib: stamp x-verified on 169 entries in paper/docs bib files
interviews: 47/47, mlperf-edu: 3/3, mlsysim/docs: 40/40,
mlsysim/paper: 71/71, periodic-table: 25/25, tinytorch: 60/60.
All repo bib files now carry x-verified markers.
2026-04-09 12:09:05 -04:00
Vijay Janapa Reddi
2ac9230b19 pass 17 bib: fix all 30 grandfathered errors + warnings, x-verify entries
Vol1 (13 fixes + 1 deletion):
- Add missing year to 7 entries (FeiFei2004, broder1997, dalal2005,
  dwork2008, talpes2005, viola2001, viola pages en-dash)
- Rename journal → booktitle on 4 entries (breck2019, chen2018, gitlab,
  holtzman2020) with expanded venue names
- Retype lapuschkin2019 @inproceedings → @article (Nature Communications)
- Retype mccarthy1956 → @misc (proposal); add DOI
- Delete jax_github (uncited orphan; correct jax2018github exists)
- Fix 2 abbreviated journals (JMLR), 2 page-range hyphens

Vol2 (12 fixes):
- Add missing year to 6 entries, title to 1, author to 1
- Rename journal → booktitle on 2 entries (gu2019, lopez2017)
- Retype Li2021 → @article, Wu2016 → @misc
- Replace schmuck2002gpfs content (was Tiger Shark 1996 → GPFS FAST '02)

Paper bibs (3 fixes):
- openai2023gpt4: add institution
- asanovic2006landscape: retype → @techreport
- kolling2001guidelines: fix LaTeX encoding

bib_lint: 0 errors, 0 grandfathered (was 30). Baseline regenerated.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-09 12:03:08 -04:00
Vijay Janapa Reddi
afc78f7bbd pass 16 bib: close 2 human-review items I could verify autonomously
Two bibliography fixes from the Pass 16 human-review backlog that had
unambiguous verification evidence from the Phase 2 parallel-agent sweep
and Crossref, so they did not require author judgment:

1. tinytorch/paper/references.bib: re-type tanenbaum1987minix

   Entry was typed @article but the cited work is A. S. Tanenbaum's
   1987 book "Operating Systems: Design and Implementation" published
   by Prentice-Hall. The entry already had publisher and isbn fields
   (added during the Pass 16 parallel-agent bib sweep); only the type
   was wrong. One-character fix: @article → @book.

2. mlsysim/paper/references.bib: fix zhang2024llmcompass DOI collision

   The Phase 2 sweep (Agent F) detected that zhang2024llmcompass and
   patel2024splitwise had the same DOI in the source bib
   (10.1109/ISCA59077.2024.00060) — impossible since they are
   different papers. Agent F verified Splitwise's correct DOI is
   10.1109/ISCA59077.2024.00019 via IEEE Xplore and applied the
   correction during the sweep.

   However, zhang2024llmcompass was left with the original DOI
   10.1109/ISCA59077.2024.00060 pending verification. Crossref
   confirms that DOI belongs to "HEAP: A Fully Homomorphic Encryption
   Accelerator with Parallelized Bootstrapping" by Agrawal et al.,
   NOT LLMCompass.

   Crossref returns the correct DOI for LLMCompass as
   10.1109/ISCA59077.2024.00082
   ("LLMCompass: Enabling Efficient Hardware Design for Large
   Language Model Inference").

   This commit updates zhang2024llmcompass.doi to the verified
   Crossref value.

Both files are now at 0 open bibliography-hygiene findings.

The 6 remaining bibliography-hygiene human-review items still in
the audit (3 fabricated entries + 3 wrong-author attributions) are
NOT touched by this commit — they require author judgment about
delete-vs-replace and re-attribution that only the author can make.
2026-04-08 19:47:28 -04:00
Vijay Janapa Reddi
fc75ec4932 paper hygiene: verify publisher/journal/doi across repo paper .bib files (73 entries)
Parallel-agent bibliography verification sweep applied to the paper
bibliography files outside the book proper. These are academic papers
that live in the repo (mlsysim tutorial paper, tinytorch paper,
interviews paper, periodic-table paper) and were previously only subject
to bibtex-tidy formatting, not §5 hygiene validation.

Batches F and G of the Pass 16 parallel sweep processed 77 entries
total across 6 files; 73 auto-applied at HIGH+MEDIUM confidence.

Per-file summary:
  mlsysim/paper/references.bib    50 entries applied (0 open)
  mlsysim/docs/references.bib     15 entries applied (0 open)
  tinytorch/paper/references.bib   7 entries applied (1 open)
  interviews/paper/references.bib  3 entries applied (0 open)
  periodic-table/paper/ref.bib    11 entries applied (0 open)

Each applied entry carries:
  publisher or journal (primary field) + doi (when present on source)
  + x-verified = "2026-04-08"
  + x-verified-by = "pass-16-bib-sweep"
  + x-verified-source = <authoritative URL from DBLP, Crossref, arXiv, etc.>

One open finding (intentional skip):
  tanenbaum1987minix — typed @article but the actual publication is
  A. S. Tanenbaum's 1987 book "Operating Systems: Design and
  Implementation" (Prentice-Hall), not a journal article. The fix is
  to re-type as @book, not fill a wrong `journal` field. Flagged for
  a future type-refactor pass.

Cross-file duplicate keys are expected and correct: dao2022flashattention,
mattson2020mlperf, and vaswani2017attention each appear in multiple
paper .bib files because each paper independently cites these
foundational works. Each copy was verified and annotated separately.

This is the first pass that the repo-wide bib_lint + bibtex-tidy
pre-commit hooks have been applied to these paper .bib files.
2026-04-08 18:25:41 -04:00
Vijay Janapa Reddi
4c31251b39 refactor: standardize paper directory structure across all three papers
Consistent layout for StaffML, mlsysim, and TinyTorch papers:
  - figures/ for all visual assets (SVGs, PDFs, PNGs)
  - scripts/ for utility scripts (analysis, validation, benchmarks)
  - tables/ for standalone table .tex files (StaffML only)
  - Makefile at root for building (created one for mlsysim)

Removed redundant build scripts (compile_paper.sh, build.sh) in
favor of Makefiles. Deleted sort_app_matrix.py (no longer needed).
Merged mlsysim images/ into figures/. Updated all references in
paper.tex, Makefiles, and CI workflows.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-05 15:57:55 -04:00
Vijay Janapa Reddi
ebb7ab2c2e style(tinytorch/paper): copyedit pass — tighten prose, cut filler
28 surgical edits:
- Remove filler/qualifiers ("perhaps most fundamentally", "genuine")
- Fix weak referents ("This approach" → name the thing)
- Convert passive to active voice
- Cut redundancy and doubled-up phrases ("creating synergy" → "linking")
- Remove LLM-ish patterns ("leverage", "synergy", "democratize")
- Tighten verbose constructions throughout
No technical content, numbers, or citations changed.
2026-04-05 10:14:12 -04:00
Vijay Janapa Reddi
3ce1049718 docs: StaffML and TinyTorch papers — URLs, footnotes, examples layout
- StaffML paper: title/unmarked MLSysBook footnote, Staff+ terminology, hyperref
  hrefurl, example questions with staffmlqmeta + staffmlscenario (mdframed)
- TinyTorch paper: tinytorch.ai on date line, same unmarked ecosystem footnote
- Regenerated StaffML fig PDFs; update macros, applicability matrix, macro generator
2026-04-04 19:36:12 -04:00
Vijay Janapa Reddi
d09e0c3763 docs: StaffML/TinyTorch papers, homepage ecosystem copy, book about links
- StaffML paper: staffml.ai on title/footnote, drop author email, hyperref black refs + blue URLs
- TinyTorch paper: same hyperref styling for neutral PDF links
- StaffML app: clarify MLSysBook ecosystem and link mlsysbook.ai/staffml
- Vol1/Vol2 about: TinyTorch and ecosystem URL wording
2026-04-04 18:10:42 -04:00
Vijay Janapa Reddi
84a4aca1d6 docs(tinytorch): add MLSYSIM integration to paper future work
Replace standalone roofline analysis section with MLSYSIM analytical
engine integration. Add mlsysim2025 citation to references.
2026-03-12 16:04:50 -04:00
Vijay Janapa Reddi
69f46d4f7e Clarifies memoization computation savings
Refines the explanation of K,V computation savings in the memoization module,
quantifying redundant computations and highlighting the efficiency gain.

The paper and module now specify that generating 100 tokens requires 5,050
total K,V computations, but only 100 are necessary, resulting in 4,950
redundant calculations.
2026-02-19 17:59:10 -05:00
Vijay Janapa Reddi
b03c32b67a docs(paper): add intra-module scaffolding subsection to progressive disclosure
Add new subsection describing function decomposition pattern used within
modules. Documents how complex operations (attention, convolution, training)
are split into focused helper functions with individual unit tests before
composition into exported functions. Updates pedagogical justification to
cover both inter-module and intra-module progressive disclosure.
2026-02-14 16:51:57 -05:00
Vijay Janapa Reddi
299fcc14e1 style(paper): tidy references.bib for pre-commit compliance
Fix line wrapping and add trailing newline to pass bibtex-tidy
pre-commit hook.
2026-02-04 10:44:02 -05:00
Vijay Janapa Reddi
24ab7599c6 fix(paper): escape special LaTeX characters breaking PDF build
Escape unescaped & characters in references.bib (Taylor & Francis,
AI & Machine-Learning) and replace Unicode em-dashes (U+2014) with
LaTeX --- ligatures in paper.tex for T1 font compatibility.
2026-02-04 10:05:32 -05:00
Vijay Janapa Reddi
e8ffd090e3 fix(paper): normalize BibTeX escaping in references.bib
Standardize LaTeX accent escaping and ampersand formatting for
consistency across bibliography entries.
2026-02-03 10:23:51 -05:00
Vijay Janapa Reddi
eb84df491e docs(paper): clarify Adam memory overhead + fix LaTeX labels
- Clarify "3× memory" → "3× optimizer-related memory (gradients plus
  two state buffers)" for accuracy
- Fix lstlisting label syntax: label=lst:... → label={lst:...}
- Remove stale figure reference, use prose instead
- Fix convolutions comment: 6 → 7 nested loops (matches actual code)
- Remove unused benchmark_table3.py
2026-01-28 17:19:55 -05:00
Vijay Janapa Reddi
e668c5b700 docs(paper): revise abstract for citation impact
- Name the problem: "algorithm-systems divide"
- Name the approach: "implementation-based systems pedagogy"
- Add concrete systems examples (O(N^2), Adam 3x memory)
- Include MLPerf-style benchmarking in milestones
- Strengthen citable terminology throughout
2026-01-28 08:27:11 -05:00
Vijay Janapa Reddi
08b7206257 fix: apply pre-commit formatting to tinytorch files
- Remove trailing whitespace in big-picture.md
- Apply bibtex-tidy formatting to paper/references.bib
2026-01-27 08:59:33 -05:00
Vijay Janapa Reddi
1654ce4bf3 Style abstract: emphasize AI engineers and pattern names 2026-01-27 07:47:30 -05:00
Vijay Janapa Reddi
aecb79026b Rewrite abstract in formal academic style 2026-01-27 07:47:30 -05:00
Vijay Janapa Reddi
2df0c69a47 Tighten abstract (1785 -> 1496 chars) 2026-01-27 07:47:30 -05:00
Vijay Janapa Reddi
ce5d0ea879 Update abstract with cleaner prose 2026-01-27 07:47:30 -05:00
Vijay Janapa Reddi
ee64168813 Expand abstract with scope, accessibility, and concrete examples 2026-01-27 07:47:30 -05:00
Vijay Janapa Reddi
0d00348cc8 Trim abstract to fit arXiv 1920 char limit 2026-01-27 07:47:30 -05:00
Vijay Janapa Reddi
e4a664b9c1 Frame AI engineers as aspirational goal in abstract 2026-01-27 07:47:29 -05:00
Vijay Janapa Reddi
7c70577ab7 Emphasize AI engineers term in abstract 2026-01-27 07:47:29 -05:00
Vijay Janapa Reddi
c8476b1010 Add AI engineer framing to abstract 2026-01-27 07:47:29 -05:00
Vijay Janapa Reddi
000e8f7f5b Restore original writing style in transitions
Remove mechanical enumeration (First/Second/Third) and meta-commentary
to match paper's flowing academic prose style
2026-01-27 07:47:29 -05:00
Vijay Janapa Reddi
673e6ff73e Improve paragraph transitions throughout paper
- Future Directions: add numbering and connecting phrases between extensions
- Limitations: add category intro and transition words
- Pedagogical Scope: clarify two-principle structure
- Conclusion: add 'First/Second/Third' and audience transition
2026-01-27 07:47:29 -05:00
Vijay Janapa Reddi
918006b957 Fix UTF-8 multiplication signs for arXiv pdflatex 2026-01-27 07:47:29 -05:00
Vijay Janapa Reddi
64ecda7289 Fix compile script to use bibtex for natbib 2026-01-27 07:47:28 -05:00
Vijay Janapa Reddi
ac4c440606 Convert date fields to year for bibtex compatibility 2026-01-27 07:47:28 -05:00
Vijay Janapa Reddi
97d786fd54 Add fontawesome5 fire icon with spacing for title 2026-01-27 07:47:28 -05:00
Vijay Janapa Reddi
3344514eed Make paper arXiv-compatible with pdflatex
- Switch from fontspec/TeX Gyre to standard fonts (mathpazo, helvet, courier)
- Replace emoji package with no-op (title is just "TinyTorch")
- Switch from biblatex/biber to natbib/bibtex
- Works with both lualatex (local) and pdflatex (arXiv)
2026-01-27 07:47:28 -05:00
Vijay Janapa Reddi
d508b4292b Update acknowledgments and GenAI disclosure
- Acknowledge CS249r students whose feedback shaped the curriculum
- Acknowledge global mlsysbook.ai community
- Expand GenAI statement to cover framework development
- Frame AI assistance as enabling democratization (single author, 20 modules)
- Remove em-dashes throughout for cleaner prose
2026-01-27 07:47:28 -05:00
Vijay Janapa Reddi
7aef7150b1 Add generative AI disclosure statement per ACM policy 2026-01-27 07:47:28 -05:00
Vijay Janapa Reddi
fd5e735494 Restore fontspec, emoji, and biblatex for local compilation
Reverts arXiv-specific changes to work with compile_paper.sh:
- Restored fontspec with TeX Gyre fonts
- Restored emoji package
- Restored biblatex with biber backend
- Works with lualatex as expected by compile script
2026-01-27 07:47:27 -05:00