Vijay Janapa Reddi 8025c66a4b fix(module-13): Rewrite LayerNorm to use Tensor operations ...

- Change from .data extraction to Tensor arithmetic (x - mean, diff * diff, x / std)
- Preserve computation graph through normalization
- std tensor now preserves requires_grad correctly

LayerNorm is used before and after attention in transformer blocks

2025-10-27 20:30:21 -04:00

..

01_tensor

fix(module-01): Fix batched matmul and transpose grad preservation

2025-10-27 20:28:53 -04:00

02_activations

fix(module-02): Rewrite Softmax to use Tensor operations

2025-10-27 20:29:35 -04:00

03_layers

fix(module-03): Rewrite Dropout to use Tensor operations

2025-10-27 20:29:43 -04:00

04_losses

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

05_autograd

fix(module-05): Add SubBackward and DivBackward for autograd

2025-10-27 20:29:54 -04:00

06_optimizers

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

07_training

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

08_dataloader

🤖 Fix transformer module exports and milestone 05 imports

2025-10-27 16:17:55 -04:00

09_spatial

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

10_tokenization

fix: Adjust ASCII diagram spacing for consistent alignment

2025-10-24 17:51:11 -04:00

11_embeddings

fix(module-11): Fix Embedding and PositionalEncoding gradient flow

2025-10-27 20:30:03 -04:00

12_attention

fix(module-12): Rewrite attention to use batched Tensor operations

2025-10-27 20:30:12 -04:00

13_transformers

fix(module-13): Rewrite LayerNorm to use Tensor operations

2025-10-27 20:30:21 -04:00

14_kvcaching

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

15_profiling

refactor: Standardize imports across modules 10-17 to match 01-09

2025-10-24 17:51:10 -04:00

16_acceleration

refactor: Standardize imports across modules 10-17 to match 01-09

2025-10-24 17:51:10 -04:00

17_quantization

refactor: Standardize imports across modules 10-17 to match 01-09

2025-10-24 17:51:10 -04:00

18_compression

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

19_benchmarking

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

20_capstone

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

archive

Clean up module imports: convert tinytorch.core to sys.path style

2025-09-30 08:58:58 -04:00

DEFINITIVE_MODULE_PLAN.md

Refactor Milestone 1: Clean forward pass with Rich CLI

2025-09-30 12:03:19 -04:00