github-starred/TinyTorch
2
0
Fork 0
mirror of https://github.com/MLSysBook/TinyTorch.git synced 2026-06-01 16:30:53 -05:00
Code Issues 7 Packages Projects Releases Wiki Activity
Files
a07451ece3abbed4200e60488243a8aa3dc71db5
TinyTorch/restructure_plan.md
Vijay Janapa Reddi f8104f726a Restructure TinyTorch into three-part learning journey (17 modules) 
- Part I: Foundations (Modules 1-5) - Build MLPs, solve XOR
- Part II: Computer Vision (Modules 6-11) - Build CNNs, classify CIFAR-10
- Part III: Language Models (Modules 12-17) - Build transformers, generate text

Key changes:
- Renamed 05_dense to 05_networks for clarity
- Moved 08_dataloader to 07_dataloader (swap with attention)
- Moved 07_attention to 13_attention (Part III)
- Renamed 12_compression to 16_regularization
- Created placeholder dirs for new language modules (12,14,15,17)
- Moved old modules 13-16 to temp_holding for content migration
- Updated README with three-part structure
- Added comprehensive documentation in docs/three-part-structure.md

This structure gives students three natural exit points with concrete achievements at each level.
2025-09-22 09:50:48 -04:00

1.3 KiB
Raw Blame History

TinyTorch Three-Part Restructure Plan

Current → Target Structure

Part I: Foundations (Modules 1-5)

  • 01_setup → 01_setup (no change)
  • 02_tensor → 02_tensor (no change)
  • 03_activations → 03_activations (no change)
  • 04_layers → 04_layers (no change)
  • 05_dense → 05_networks (rename for clarity)

Part II: Computer Vision (Modules 6-11)

  • 06_spatial → 06_spatial (no change)
  • 07_attention → 13_attention (move to Part III)
  • 08_dataloader → 07_dataloader (renumber)
  • NEW → 08_normalization (create from scratch or extract)
  • 09_autograd → 09_autograd (no change)
  • 10_optimizers → 10_optimizers (no change)
  • 11_training → 11_training (no change)

Part III: Language Models (Modules 12-17)

  • NEW → 12_embeddings (create new)
  • 07_attention → 13_attention (moved from Part II, expanded)
  • NEW → 14_transformers (create new)
  • NEW → 15_generation (create new)
  • 12_compression → 16_regularization (rename and expand)
  • 13_kernels + 14_benchmarking + 15_mlops → 17_systems (combine)

Migration Steps

  1. Fix duplicate 09_dataloader issue
  2. Rename modules that need renaming
  3. Move modules to new positions
  4. Create new modules for language model components
  5. Update imports and dependencies
  6. Update checkpoint system
  7. Update documentation
Reference in New Issue View Git Blame Copy Permalink