mirror of
https://github.com/MLSysBook/TinyTorch.git
synced 2026-04-28 12:32:31 -05:00
a1c858198e
- Create standalone verify_kv_cache_speedup() function (Part 5) - Measures ACTUAL timing with/without cache using time.perf_counter() - Simulates O(n²) vs O(n) complexity with real matrix operations - Verifies speedup grows with sequence length (characteristic of O(n²)→O(n)) - test_module() calls verification function cleanly - Returns dict with all speedups, times, and verification status - Includes example usage in __main__ block - Update section numbering: Systems Analysis now Part 6 Verification shows: - 10 tokens: ~10× speedup - 100 tokens: >10× speedup (growing with length) - Demonstrates O(n²)→O(n) complexity reduction
TinyTorch Modules Directory
This directory contains student-facing Jupyter notebooks for learning ML systems from scratch.
📦 Module Structure
Each module directory contains:
{module}_dev.py- Jupytext Python file (source of truth){module}.ipynb- Jupyter notebook (auto-generated)README.md- Module overview and learning objectives
🔄 How Modules Are Created
Modules are automatically exported from src/ using the following workflow:
- Source notebooks live in
src/{module}/as.ipynbfiles - Run export:
tito system export {module}ornbdev_export - Auto-generated files appear in
modules/{module}/
The src/ directory is where development happens. The modules/ directory is what students use.
📚 Available Modules
Modules will be populated as you complete the TinyTorch learning path:
- ✅
01_tensor- Tensor fundamentals and operations - ✅
02_activations- Activation functions (ReLU, Sigmoid, etc.) - ✅
04_losses- Loss functions for training - ✅
06_optimizers- Optimization algorithms (SGD, Adam, etc.) - 🔒 Additional modules unlock as you progress...
🚀 Getting Started
- Check module status:
tito module status - Start a module:
tito module start 01 - Work on the module: Opens Jupyter Lab automatically
- Complete the module:
tito module complete 01
Each module builds on previous ones, creating a complete ML framework from scratch!