TinyTorch/examples

TinyTorch Examples 🔥

Beautiful, real-world examples showcasing TinyTorch capabilities with stunning visualization!

🎯 What Makes These Special?

• Gorgeous Rich UI with real-time ASCII plots
• Professional ML patterns using TinyTorch as a complete framework
• Verified performance on real datasets
• Educational excellence - students see exactly what's happening

🚀 Quick Start

# XOR with beautiful visualization (30 seconds):
python examples/xornet/train_with_dashboard.py

# CIFAR-10 image classification with Rich UI (2 minutes):
python examples/cifar10/train_with_dashboard.py

# Advanced optimization targeting 60% (5+ minutes):
python examples/cifar10/train_optimized_60.py

📁 Available Examples

🧠 XOR Neural Network (xornet/)

Classic non-linear function learning with beautiful visualization

• Performance: 100% accuracy (perfect XOR solution)
• Features: Real-time ASCII plots, Rich UI, convergence visualization
• Architecture: 2 → 8 → 1 with ReLU
• Training Time: <30 seconds

cd examples/xornet/
python train_with_dashboard.py

🖼️ CIFAR-10 Image Classification (cifar10/)

Real-world computer vision with stunning training visualization

Standard Training (train_with_dashboard.py)

• Performance: 53%+ accuracy on real images
• Features: Rich UI, real-time plots, comprehensive metrics
• Dataset: 60,000 32×32 color images (10 classes)
• Training Time: ~2 minutes

Advanced Optimization (train_optimized_60.py)

• Target: 60%+ accuracy with cutting-edge techniques
• Architecture: 7-layer deep MLP (11.7M parameters)
• Techniques: Dropout, advanced augmentation, learning rate scheduling
• Features: Top-3 accuracy, class balance metrics, gradient clipping

cd examples/cifar10/
python train_with_dashboard.py        # Standard training
python train_optimized_60.py          # Advanced optimization

🎨 Universal Training Dashboard

All examples use the beautiful common/training_dashboard.py:

• Real-time ASCII plotting of accuracy and loss curves
• Rich console interface with progress bars and tables
• Comprehensive metrics (confidence, class accuracy, learning rates)
• Engaging visualization that makes training exciting
• Educational focus - students see every aspect of training

📊 Performance Achievements

Example	Accuracy	Training Time	Features
XOR	100%	<30s	Perfect convergence visualization
CIFAR-10 Standard	53%+	~2min	Rich UI, real-time plots
CIFAR-10 Advanced	Targeting 60%	~5min	Cutting-edge optimization

Comparison Context:

• Random chance (CIFAR-10): 10%
• Typical ML course MLPs: 50-55%
• TinyTorch: 53-60%+ 🔥
• Research MLP SOTA: 60-65%
• Simple CNNs: 70-80%

🛠️ Technical Highlights

Advanced Optimization Techniques

• Deep architectures (up to 7 layers)
• Dropout simulation for regularization
• Progressive data augmentation
• Learning rate scheduling (warmup + cosine annealing)
• Gradient clipping simulation
• Advanced weight initialization

Beautiful Visualization

• ASCII plotting works in any terminal
• No external dependencies (self-contained)
• Rich console interface with colors and formatting
• Real-time updates showing training progress
• Multiple metrics displayed simultaneously

🎓 Educational Value

Students experience:

• Visual feedback during training
• Real-world performance on challenging datasets
• Professional code patterns using their own framework
• Advanced techniques pushing the limits of what's possible
• Immediate gratification seeing their code work on real problems

🏗️ Structure

examples/
├── common/
│   └── training_dashboard.py    # Universal Rich UI dashboard
├── xornet/
│   ├── README.md               # XOR problem details
│   └── train_with_dashboard.py # XOR with beautiful UI
└── cifar10/
    ├── README.md               # Image classification details
    ├── train_with_dashboard.py # Standard CIFAR-10 training
    └── train_optimized_60.py   # Advanced optimization

---

These aren't toy demos - they're polished ML applications with gorgeous visualization, achieving competitive results with a framework built entirely from scratch! 🚀