mirror of
https://github.com/MLSysBook/TinyTorch.git
synced 2026-05-27 17:35:51 -05:00
e647d9b3e7
- Added typing imports (List, Dict, Tuple, Optional, Set) to export section - Fixed NameError: name 'List' is not defined - Fixed milestone copilot references from SimpleTokenizer to CharTokenizer - Verified transformer learning: 99.1% loss decrease in 500 steps Training results: - Initial loss: 3.555 - Final loss: 0.031 - Training time: 52.1s for 500 steps - Gradient flow: All 21 parameters receiving gradients - Model: 1-layer GPT with 32d embeddings, 4 heads