- Create comprehensive learning timeline page showing 60+ years of ML evolution
- Visual progress timeline from Perceptron (1957) to TinyMLPerf (2025)
- Module progression map with historical context and achievements
- Capability checkpoints tracking system integration
- Clean up emoji usage in TOC for professional presentation
- Add timeline as first item in Getting Started section
- Show students exactly what they'll build at each milestone
- Connect each module to real historical breakthroughs
- Emphasize progression from foundation to production systems
- Update README and website to be more professional while staying welcoming
- Remove excessive emojis from headers and tables
- Keep strategic emoji usage for emphasis (checkmarks, warnings)
- Clean up module tables and section headers
- Update Mermaid diagrams to be cleaner
- Fix module count (20 not 16) and accuracy claims (75%+ CIFAR-10)
- Strengthen ML Systems engineering messaging throughout
- Update milestone examples with correct historical references
- Maintain accessibility and professional tone
Major changes:
- Moved TinyGPT from Module 16 to examples/tinygpt (capstone demo)
- Fixed Module 10 (optimizers) and Module 11 (training) bugs
- All 16 modules now passing tests (100% health)
- Added comprehensive testing with 'tito test --comprehensive'
- Renamed example files for clarity (train_xor_network.py, etc.)
- Created working TinyGPT example structure
- Updated documentation to reflect 15 core modules + examples
- Added KISS principle and testing framework documentation
- Update intro.md to show realistic 57.2% CIFAR-10 accuracy
- Replace aspirational 75% compression claims with actual achievements
- Highlight 100% XOR accuracy milestone
- Clean up milestone examples to match new directory structure
- Remove outdated example references from milestones
Website documentation now accurately reflects TinyTorch capabilities!
- Remove 00_introduction module (meta-content, not substantive learning)
- Remove 16_capstone_backup backup directory
- Remove utilities directory from modules/source
- Clean up generated book chapters for removed modules
Result: Clean 16-module progression (01_setup → 16_tinygpt) focused on
hands-on ML systems implementation without administrative overhead.
- Corrected module dependencies based on actual YAML files
- Fixed diagram to show accurate prerequisite relationships:
- Tensor directly enables both Activations and Autograd
- DataLoader depends directly on Tensor (not through Spatial)
- Training depends on Dense, Spatial, Attention, Optimizers, and DataLoader
- TinyGPT depends on Attention, Optimizers, and Training
- Added sphinxcontrib-mermaid to requirements for diagram rendering
- Updated both intro.md and README.md with corrected diagrams
- Ensured mermaid extension is configured in _config.yml
- Tighten line spacing from 1.8 to 1.6 for better readability
- Reduce header margins for more compact appearance
- Add educational links (Binder, Colab) with proper URLs
- Fix time duplication in badges (use difficulty stars instead)
- Simplify setup module content for better clarity
- Improve content hierarchy with proper nesting
- Professional ML Engineering Skills section now properly organizes steps
- Consistent badge formatting across all modules
- More compact and professional appearance overall
- Replace Source Sans/Serif Pro with Inter for better screen readability
- Add JetBrains Mono for superior code display
- Increase body font size from 16px to 17px for better readability
- Optimize line height to 1.8 for comfortable reading
- Add proper font weights and letter spacing hierarchy
- Improve color contrast for accessibility
- Add CSS custom properties for maintainable design tokens
- Enhanced focus states and text selection
- Professional academic typography matching top educational platforms
- Remove excessive emojis while maintaining strategic usage
- Update CSS with academic typography (Source Sans Pro, Source Serif Pro)
- Professional color scheme with academic blues (#2c3e50, #3498db)
- Clean navigation without emoji decorations
- Enhanced visual hierarchy with professional spacing
- University-level styling consistent with Harvard standards
- Maintained pedagogical effectiveness and engagement
- Improved readability with clean, accessible design
- Professional tone throughout all content
- Academic credibility without sacrificing approachability
- Replace ugly gray background with clean white theme
- Add proper logo styling and configuration
- Update book chapters from module READMEs
- Add educational-ml-docs-architect agent
- Clean up custom CSS for better readability
- Configure logo.png in correct location
- Update tito book command with proper chapters
Major Educational Framework Enhancements:
• Deploy interactive NBGrader text response questions across ALL modules
• Replace passive question lists with active 150-300 word student responses
• Enable comprehensive ML Systems learning assessment and grading
TinyGPT Integration (Module 16):
• Complete TinyGPT implementation showing 70% component reuse from TinyTorch
• Demonstrates vision-to-language framework generalization principles
• Full transformer architecture with attention, tokenization, and generation
• Shakespeare demo showing autoregressive text generation capabilities
Module Structure Standardization:
• Fix section ordering across all modules: Tests → Questions → Summary
• Ensure Module Summary is always the final section for consistency
• Standardize comprehensive testing patterns before educational content
Interactive Question Implementation:
• 3 focused questions per module replacing 10-15 passive questions
• NBGrader integration with manual grading workflow for text responses
• Questions target ML Systems thinking: scaling, deployment, optimization
• Cumulative knowledge building across the 16-module progression
Technical Infrastructure:
• TPM agent for coordinated multi-agent development workflows
• Enhanced documentation with pedagogical design principles
• Updated book structure to include TinyGPT as capstone demonstration
• Comprehensive QA validation of all module structures
Framework Design Insights:
• Mathematical unity: Dense layers power both vision and language models
• Attention as key innovation for sequential relationship modeling
• Production-ready patterns: training loops, optimization, evaluation
• System-level thinking: memory, performance, scaling considerations
Educational Impact:
• Transform passive learning to active engagement through written responses
• Enable instructors to assess deep ML Systems understanding
• Provide clear progression from foundations to complete language models
• Demonstrate real-world framework design principles and trade-offs
Major changes:
- Renamed entire system from "milestone" to "checkpoint" for academic framing
- Checkpoints are now positioned as academic progress markers in learning journey
- Implemented enhanced Rich CLI timeline with progress bars and connecting lines
- Added overall progress tracking (16/16 modules = 100%)
Enhanced timeline visualization:
- Horizontal view shows progress bar with filled/unfilled segments
- Visual connecting lines between checkpoints showing completion status
- Color-coded progress: green (complete), yellow (in-progress), dim (future)
- Percentage indicators for each checkpoint and overall progress
CLI improvements:
- `tito checkpoint status` - Shows overall and per-checkpoint progress
- `tito checkpoint timeline --horizontal` - Rich visual progress line
- `tito checkpoint timeline` - Vertical tree view with module details
- Better progress indicators with filled bars and connecting lines
Documentation updates:
- Renamed milestone-system.md to checkpoint-system.md
- Updated all references from milestone to checkpoint terminology
- Emphasized academic checkpoint philosophy and progress markers
- Added descriptions of new Rich CLI visualizations
Benefits:
- More academic framing aligns with educational context
- Visual progress bars provide immediate feedback on learning journey
- Checkpoint terminology is more familiar to students
- Rich CLI visualizations make progress tracking engaging
Features implemented:
- Complete milestone tracking system with Foundation → Architecture → Training → Inference → Serving progression
- Rich CLI visualization with status, timeline (horizontal/vertical), and progress tracking
- Ticker-based granular progress within each milestone showing module completion
- Comprehensive documentation explaining the pedagogical approach and system benefits
- Integration with existing tito CLI infrastructure and module detection
Key capabilities:
- `tito milestone status` - shows current progress and capabilities unlocked
- `tito milestone timeline` - visual progress timeline with multiple views
- `tito milestone test/unlock` - placeholder for future capability testing
- Automatic module detection and progress calculation
- Clear capability statements for each milestone achievement
Benefits:
- Transforms learning from "completing modules" to "building capabilities"
- Provides clear motivation through visual progress and capability unlocks
- Aligns with real ML engineering workflow: Foundation → Architecture → Training → Inference → Serving
- Gives students concrete sense of progress toward complete ML framework
- Moved Introduction to "Course Orientation" section (no longer Module 0)
- Renumbered all modules: Setup becomes Module 0, course now has 16 modules
- Updated table of contents to separate orientation from formal course modules
- Updated intro.md and vision.md to reflect 16 modules instead of 17
- Course now starts immediately with hands-on implementation (Setup)
- Maintains Build→Use→Reflect philosophy by removing non-implementation module
- Introduction remains accessible as orientation material without being numbered module
- Enhanced book/intro.md with comprehensive ML systems vision sections including "Our Vision", "Systems-First Thinking", "Beyond Code: Systems Intuition", and expanded "Who This Is For"
- Created book/vision.md with complete educational philosophy explaining the problem TinyTorch solves, systems thinking approach, target audience, and learning outcomes
- Updated book/_toc.yml to include vision document in Additional Resources section
- Content emphasizes training ML systems engineers vs ML users, focusing on memory management, performance analysis, and production trade-offs
- Maintains existing structure for NBGrader compatibility while clearly communicating educational vision to students
- Create comprehensive introduction module (00-introduction.md) for Jupyter Book
- Add visual system overview and architecture documentation
- Update TOC to include introduction as module 0 in Foundation section
- Refactor classroom-use.md to be high-level overview pointing to instructor guide
- Eliminate duplication between classroom-use and instructor guide
- Ensure all 17 modules (00-16) are properly documented
Features:
- Introduction module provides system overview and dependency visualizations
- Clear separation: classroom-use = overview, instructor-guide = detailed workflow
- Professional navigation structure with all modules properly ordered
- Cross-references between related documentation sections
Successfully built and tested with jupyter-book build.
- Create complete instructor guide with user journey from setup to course completion
- Cover all phases: setup, course prep, assignment management, grading workflow
- Include weekly routines, troubleshooting, and student guidance
- Add quick reference card for daily commands
- Update Jupyter Book TOC to include instructor documentation
- Update classroom-use guide to reference comprehensive documentation
Features documented:
- 30-minute initial setup process
- Weekly assignment workflow (generate -> release -> grade -> feedback)
- Batch operations for efficiency
- System monitoring and analytics
- End-to-semester procedures
- Student support guidelines
- Common troubleshooting scenarios
Provides complete user journey for instructors and TAs using NBGrader + TinyTorch.
- Replace hardcoded module names array with dynamic reading from module.yaml files
- Add get_module_names() function to read actual module structure
- Fix IndexError in get_prev_module_name() and get_next_module_name() functions
- Update navigation logic to use actual module count instead of hardcoded assumptions
- Successfully converts all 16 modules to chapters with proper navigation
- Book build now completes without errors
- Remove generic learning communities section
- Remove vague 'next steps' career advice
- Remove fluffy usage instructions
- Keep focused: academic courses, books, alternative implementations, production internals
- Result: curated reference for students who built ML systems from scratch
✂️ Reduced MLOps Focus:
- Renamed 'MLOps & Production' → 'Development Tools'
- Removed redundant 'MLOps Community' link
- Focuses on practical development tools instead
🎯 Made Framework Differentiations Distinct:
- Micrograd: 'shows you the math, TinyTorch shows you the systems'
- Tinygrad: 'optimizes for speed, TinyTorch optimizes for learning'
- NNFS: 'focuses on algorithms, TinyTorch focuses on complete systems engineering'
💡 Benefits:
- Each differentiation now highlights specific strengths vs repetitive vehicle analogy
- Less MLOps emphasis (appears in course already)
- More concise and memorable comparisons
Result: Cleaner resource organization with unique, specific differentiations
that avoid repetition and over-emphasis on any single topic.
🔥 Major Improvements:
- Removed research papers section (belongs in specific labs as context)
- Added clear differentiation for alternative implementations with vehicle analogy
- Moved ML Systems book to books section with prominent positioning
- Added actual book links (O'Reilly, deeplearningbook.org) where available
- Focused on maintainable, stable resources
🎯 Key Differentiations Added:
- 'Micrograd teaches engine parts, TinyTorch teaches you to design the whole vehicle'
- 'NNFS teaches engine parts, TinyTorch teaches the whole vehicle and drive it'
- 'Tinygrad optimizes for speed, TinyTorch optimizes for learning systems thinking'
🏭 Production Focus:
- Added industrial tools: W&B, MLOps Community, Papers with Code
- Reorganized into: Courses, Books, Alternative Implementations, Production Tools
- Removed quickly-outdated content, kept stable educational resources
📖 ML Systems Book Positioning:
- Moved Vijay's book from courses to books section
- Positioned as 'the perfect companion to TinyTorch'
- Added proper book links for maintainability
Result: Much more focused, maintainable resource page that complements
TinyTorch without duplicating content that belongs in specific labs.
🎓 Course Additions:
- Added CS 249r: Tiny Machine Learning (Harvard) to course list
- Covers TinyML systems, edge AI, and resource-constrained machine learning
- Complements existing MIT TinyML course with Harvard perspective
📖 Section Naming Fix:
- Changed 'Essential Books' → 'Recommended Books'
- Avoids prescriptive language and duplication issues
- More inclusive and less hierarchical phrasing
🔄 Organization Benefits:
- Eliminates potential confusion with ML Systems book already in courses
- Creates clearer separation between course materials and supplementary books
- Better reflects that these are helpful additions, not requirements
Result: More thoughtful resource organization with key Harvard tinyML
course addition and improved section naming.
🔧 Title Configuration Fix:
- Changed book/_config.yml title from long form to simple 'Tiny🔥Torch'
- Eliminates duplicate title in browser tab (was showing 'Tiny🔥Torch — Tiny🔥Torch')
- Now Chrome tab displays clean 'Tiny🔥Torch' once
Result: Clean, professional browser tab title without duplication.
🔄 Chapter File Reorganization:
- Renamed 05-networks.md → 05-dense.md
- Renamed 06-cnn.md → 06-spatial.md
- Created 07-attention.md with transformer-focused content
- Renumbered all subsequent chapters (7→8, 8→9, 9→10, etc.)
- Updated final module: 15-capstone.md → 16-capstone.md
📚 Attention Chapter Content:
- Added comprehensive attention module introduction
- Covers self-attention, multi-head attention, transformer foundations
- Explains Query-Key-Value mechanism and scaled dot-product attention
- Connects to previous modules (tensors, activations, layers, dense)
- Positions attention as foundation for modern AI (GPT, BERT, ViTs)
✅ Build Verification:
- Jupyter Book builds successfully with no missing file errors
- All 16 chapters now properly indexed in table of contents
- New structure: Foundation (1-3), Building Blocks (4-7), Training (8-11),
Inference & Serving (12-16)
Result: Complete alignment between repository structure, book chapters,
and table of contents. Students can now navigate the full 16-module course
with proper attention coverage and updated section organization.
📖 New Resources Page:
- Created book/resources.md with curated external learning materials
- Academic courses: Stanford CS329S, Harvard ML Systems, MIT TinyML
- Essential books: Chip Huyen, Andriy Burkov, Deep Learning textbook
- Framework deep dives: PyTorch/TensorFlow internals and architecture
- Research papers: Autograd, Adam, Attention, TensorFlow/PyTorch papers
- Implementation guides: micrograd, tinygrad, Neural Networks from Scratch
- Communities: MLOps, r/MachineLearning, technical blogs
- Next steps: Post-TinyTorch learning paths and advanced specializations
🔄 Updated Table of Contents:
- Fixed module names: networks → dense, cnn → spatial
- Added 07_attention to Building Blocks section
- Updated all numbering to reflect 16-module structure
- Renamed 'Production & Performance' → 'Inference & Serving'
- Added new 'Additional Resources' section with 📚 Learning Resources
🎯 Educational Value:
- Provides context for TinyTorch implementations
- Bridges from educational framework to production systems
- Offers multiple learning paths for different interests
- Connects TinyTorch concepts to broader ML systems ecosystem
Result: Students now have comprehensive resources to deepen their
understanding and apply TinyTorch knowledge to real-world systems.
✨ Title Formatting:
- Split title into main header and subtitle for better readability
- Enhanced visual hierarchy in book introduction
🚀 Content Updates:
- Changed 'rocket ship' to 'AI rocket ship' for more specific branding
- Added '(Harvard)' to Prof. Vijay Janapa Reddi reference for clarity
- Maintains professional attribution while being more informative
Result: Cleaner book intro formatting with improved readability and attribution.
- Address math anxiety: explain math learning approach
- Address validation fears: highlight testing and feedback
- Address flexibility concerns: explain module dependencies
- Address toy project skepticism: emphasize real data and results
- Focus on actual questions students ask vs generic course info
- 4 key questions for students already interested in the course
- Focus on practical learning concerns vs skepticism
- Shorter than GitHub FAQ - appropriate for committed learners
- Covers time investment, skill level, support, modern relevance
- Regenerated all chapters with YAML-based difficulty ratings
- Updated book with improved navigation and fixed appendix links
- Applied copyright year 2025 across all pages
- Integrated inclusive language changes throughout generated content
- Book now reflects all UX and consistency improvements
- Added educational metadata (difficulty, time_estimate) to all module.yaml files
- Updated convert_readmes.py to read from YAML instead of hardcoded mappings
- Standardized difficulty progression: ⭐ → ⭐⭐ → ⭐⭐⭐ → ⭐⭐⭐⭐ → ⭐⭐⭐⭐⭐🥷
- Fixed path resolution for YAML reading in book build process
- Eliminated duplication: single source of truth for educational metadata
- Capstone gets special ninja treatment (⭐⭐⭐⭐⭐🥷) as beyond-expert level
- Updated book generation to include 15_capstone with 5-star difficulty rating
- Changed time estimate from '20-40 hours' to 'Capstone Project' for better visitor experience
- Removed specific week references from project phases for more encouraging presentation
- Maintained detailed project structure while making timeline more flexible
- Ensures consistent 5-star rating for expert-level modules across the framework
- Changed from ambitious app development (computer vision, NLP, etc.) to realistic framework engineering
- New focus areas: performance optimization, algorithm extensions, systems engineering, benchmarking analysis, developer tools
- Projects now align with what students actually built: a complete ML framework
- Emphasizes systems engineering and optimization skills rather than application development
- Maintains 'no PyTorch imports' constraint to prove deep framework understanding
- Added 'Complete System Integration' section emphasizing how all 14 modules connect
- Highlighted that students build ONE cohesive ML framework, not isolated exercises
- Added capstone project section encouraging real applications using only TinyTorch
- Updated README.md 'What You'll Build' to emphasize system integration
- Added visual flow diagram showing module dependencies and connections
- Emphasized 'no PyTorch imports' constraint to prove framework completeness
Key additions:
- og:title, og:description, og:url, og:type, og:image for Open Graph
- twitter:card, twitter:title, twitter:description, twitter:image for Twitter
- Uses astronaut/rocket ship tagline for memorable social sharing
- Proper property/name attributes for platform compatibility
This will enable rich previews when sharing TinyTorch links in Slack, Twitter, etc.
Updates the introduction with additional motivational context and a clearer explanation of TinyTorch's purpose.
Emphasizes the hands-on learning approach and the benefits of building ML frameworks from scratch.
Replaces a sentence with an analogy to enhance the message's impact.
