Code

Add loss generating token counts#1610

Code

Merged

dakinggg merged 12 commits intomosaicml:mainmosaicml/llm-foundry:mainfrom dakinggg:loss-gen-tokensdakinggg/llm-foundry:loss-gen-tokensCopy head branch name to clipboardOct 27, 2024

+106-50

Commits

Commits on Oct 16, 2024

• should work

  dakinggg

  committed
  5d938e5

  Copy full SHA for 5d938e5

• pc

  dakinggg

  committed
  8ba4ecf

  Copy full SHA for 8ba4ecf

Commits on Oct 23, 2024

• Merge branch 'main' into loss-gen-tokens

  dakinggg

  committed
  09e0749

  Copy full SHA for 09e0749

Commits on Oct 24, 2024

• fix off by one

  dakinggg

  committed
  5f0ed6e

  Copy full SHA for 5f0ed6e

• pc

  dakinggg

  committed
  a2438b3

  Copy full SHA for a2438b3

Commits on Oct 25, 2024

• fix off by one

  dakinggg

  committed
  e145e59

  Copy full SHA for e145e59

• fix

  dakinggg

  committed
  767efbb

  Copy full SHA for 767efbb

• fix types

  dakinggg

  committed
  ea16fcd

  Copy full SHA for ea16fcd

• remove print

  dakinggg

  committed
  6792abd

  Copy full SHA for 6792abd

• pc and cleanup

  dakinggg

  committed
  4d720ad

  Copy full SHA for 4d720ad

• fix

  dakinggg

  committed
  894c54f

  Copy full SHA for 894c54f

Commits on Oct 27, 2024

• Merge branch 'main' into loss-gen-tokens

  dakinggg

  authored
  34e00c2

  Copy full SHA for 34e00c2