Vijay Janapa Reddi 9bf4abe2ec fix(module-11): Fix Embedding and PositionalEncoding gradient flow ...

- Embedding.forward() now preserves requires_grad from weight tensor
- PositionalEncoding.forward() uses Tensor addition (x + pos) instead of .data
- Critical for transformer input embeddings to have gradients

Both changes ensure gradient flows from loss back to embedding weights

2025-10-27 20:30:03 -04:00

..

01_tensor

fix(module-01): Fix batched matmul and transpose grad preservation

2025-10-27 20:28:53 -04:00

02_activations

fix(module-02): Rewrite Softmax to use Tensor operations

2025-10-27 20:29:35 -04:00

03_layers

fix(module-03): Rewrite Dropout to use Tensor operations

2025-10-27 20:29:43 -04:00

04_losses

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

05_autograd

fix(module-05): Add SubBackward and DivBackward for autograd

2025-10-27 20:29:54 -04:00

06_optimizers

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

07_training

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

08_dataloader

🤖 Fix transformer module exports and milestone 05 imports

2025-10-27 16:17:55 -04:00

09_spatial

feat: Add Milestone 04 (CNN Revolution 1998) + Clean spatial imports

2025-09-30 17:04:41 -04:00

10_tokenization

fix: Adjust ASCII diagram spacing for consistent alignment

2025-10-24 17:51:11 -04:00

11_embeddings

fix(module-11): Fix Embedding and PositionalEncoding gradient flow

2025-10-27 20:30:03 -04:00

12_attention

🤖 Fix transformer module exports and milestone 05 imports

2025-10-27 16:17:55 -04:00

13_transformers

✅ Complete transformer module fixes and milestone 05

2025-10-27 16:46:06 -04:00

14_kvcaching

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

15_profiling

refactor: Standardize imports across modules 10-17 to match 01-09

2025-10-24 17:51:10 -04:00

16_acceleration

refactor: Standardize imports across modules 10-17 to match 01-09

2025-10-24 17:51:10 -04:00

17_quantization

refactor: Standardize imports across modules 10-17 to match 01-09

2025-10-24 17:51:10 -04:00

18_compression

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

19_benchmarking

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

20_capstone

Fix nbdev export system across all 20 modules

2025-09-30 11:21:04 -04:00

archive

Clean up module imports: convert tinytorch.core to sys.path style

2025-09-30 08:58:58 -04:00

DEFINITIVE_MODULE_PLAN.md

Refactor Milestone 1: Clean forward pass with Rich CLI

2025-09-30 12:03:19 -04:00