Code

Add RMSNorm#629

Code

Merged

patrick-kidger merged 4 commits intopatrick-kidger:devpatrick-kidger/equinox:devfrom jondeaton:rmsnormjondeaton/equinox:rmsnormCopy head branch name to clipboardDec 28, 2023

+128-1

Commits

Commits on Oct 8, 2023

• Added RMSNorm

  packquickly

  committed
  72d4ff6

  Copy full SHA for 72d4ff6

Commits on Oct 10, 2023

• fix numerics to match paper

  packquickly

  committed
  790de08

  Copy full SHA for 790de08

Commits on Dec 27, 2023

• Address code reviews.

  jondeaton

  committed
  bab8e4a

  Copy full SHA for bab8e4a

Commits on Dec 28, 2023

• Default on for element-wise affine parameters.

  jondeaton

  committed
  22055c4

  Copy full SHA for 22055c4