mirror of
https://github.com/MLSysBook/TinyTorch.git
synced 2026-05-07 17:02:34 -05:00
fdc508ddf8
BREAKTHROUGH ACHIEVEMENTS: ✅ 100% accuracy (4/4 XOR cases correct) ✅ Perfect convergence: Loss 0.2930 → 0.0000 ✅ Fast learning: Working by epoch 100 ✅ Clean implementation using proven patterns KEY INSIGHTS: - ReLU activation alone is sufficient for XOR (no Sigmoid needed) - Architecture: 2 → 4 → 1 with He initialization - Learning rate 0.1 with bias gradient aggregation - Matches reference implementations from research VERIFIED PERFORMANCE CLAIMS: - Students can achieve 100% XOR accuracy with their own framework - TinyTorch demonstrates real learning on classic ML problem - Implementation follows working autograd patterns Ready for students - example actually works as advertised!
TinyTorch Examples 🔥
Real-world examples showing what you can build with TinyTorch!
What Are These Examples?
These are real ML applications written using TinyTorch just like you would use PyTorch. Each example:
- Uses
import tinytorchas a real package - Shows professional ML code patterns
- Demonstrates actual capabilities you've built
- Can be run by anyone to see TinyTorch in action
Running Examples
# After installing/building TinyTorch:
cd examples/xornet/
python train.py
# Or for image classification:
cd examples/cifar10/
python train_cifar10_mlp.py
Available Examples
🧠 xornet/ - Neural Network Fundamentals
- Classic XOR problem with hidden layers
- Clean implementation showing autograd and training basics
- Architecture: 2 → 4 → 1 with ReLU and Sigmoid
- Achieves 100% accuracy on XOR truth table
👁️ cifar10/ - Real-World Computer Vision
- Real-world object classification
- ACHIEVEMENT: 57.2% accuracy - exceeds typical ML course benchmarks!
- Multiple architectures: MLP, LeNet-5, and optimized models
- Data augmentation, proper initialization, Adam optimization
- Real dataset: 50,000 training images, 10,000 test images
Example Structure
Each example directory contains:
example_name/
├── train.py # Main training script
├── README.md # What this example demonstrates
└── data/ # Datasets (downloaded automatically)
Learning Progression
After completing each module, examples become functional:
- Module 05 →
xornet/works (Dense layers + activations) - Module 11 →
cifar10/works with training loops
Quick Demo
Want to see TinyTorch in action? Try these:
# See a neural network learn XOR (30 seconds):
python examples/xornet/train.py
# Train on real images (5 minutes, 57% accuracy):
python examples/cifar10/train_cifar10_mlp.py --epochs 10
Performance Achievements
- XORnet: 100% accuracy (perfect solution)
- CIFAR-10: 57.2% accuracy (exceeds typical course benchmarks)
These aren't toy demos - they're real ML applications achieving competitive results with a framework built from scratch!