Vijay Janapa Reddi 8025c66a4b fix(module-13): Rewrite LayerNorm to use Tensor operations ...

- Change from .data extraction to Tensor arithmetic (x - mean, diff * diff, x / std)
- Preserve computation graph through normalization
- std tensor now preserves requires_grad correctly

LayerNorm is used before and after attention in transformer blocks

2025-10-27 20:30:21 -04:00

..

source

fix(module-13): Rewrite LayerNorm to use Tensor operations

2025-10-27 20:30:21 -04:00