Code

Implement MMLU_Evaluator.run()#10

Code

Merged

alimaredia merged 7 commits intoinstructlab:maininstructlab/eval:mainfrom alinaryan:mmlualinaryan/eval:mmluCopy head branch name to clipboardJun 25, 2024

+53-13

Commits

Commits on Jun 25, 2024

• Introduce lm-evaluation-harness dependency

  Show description for 6db41b1
  alinaryan

  committed
  6db41b1

  Copy full SHA for 6db41b1

• working MMLU_Evaluator.run()

  Show description for 8e024b8
  

  alimaredia

  authored and

  alinaryan

  committed
  8e024b8

  Copy full SHA for 8e024b8

• Remove testing code and change the MMLU class names and descriptions

  Show description for 05233b4
  alinaryan

  committed
  05233b4

  Copy full SHA for 05233b4

• Add missing model_path param and description

  Show description for 2e607f5
  alinaryan

  committed
  2e607f5

  Copy full SHA for 2e607f5

• Fix lint errors

  Show description for 270bf53
  alinaryan

  committed
  270bf53

  Copy full SHA for 270bf53

• suppress import err

  Show description for 88b2e65
  alinaryan

  committed
  88b2e65

  Copy full SHA for 88b2e65

• Add fstring

  Show description for 899aaf9
  alinaryan

  committed
  899aaf9

  Copy full SHA for 899aaf9