mirror of
https://github.com/harvard-edge/cs249r_book.git
synced 2026-07-21 00:23:30 -05:00
29122c2066
* Document GELU activation function in 02_activations.qmd Added GELU activation function explanation and implementation. * docs(tinytorch): add GELU implementation This commit adds the GELU activation function implementation to the 2nd module in the docs. * Update GELU code to reflect src code change Refactor GELU activation to use a simplified sigmoid approximation. * docs(tinytorch): polish GELU activation section --------- Co-authored-by: Vijay Janapa Reddi <vj@eecs.harvard.edu>