Code

Refactor#5

Code

Open

tcapelle wants to merge 65 commits intomainwandb/evalForge:mainfrom capewandb/evalForge:capeCopy head branch name to clipboard

+12,939-1,289

Commits

Commits on Oct 30, 2024

• move outside

  tcapelle

  committed
  94f3984

  Copy full SHA for 94f3984

• move to notebooks

  tcapelle

  committed
  650d4d9

  Copy full SHA for 650d4d9

• add data

  tcapelle

  committed
  af7c3c5

  Copy full SHA for af7c3c5

• enable git lfs

  tcapelle

  committed
  1292407

  Copy full SHA for 1292407

• test and publish

  tcapelle

  committed
  f9fb498

  Copy full SHA for f9fb498

• make it installable

  tcapelle

  committed
  92dc585

  Copy full SHA for 92dc585

• amazon reviews

  tcapelle

  committed
  c64552a

  Copy full SHA for c64552a

• add json to LFS

  tcapelle

  committed
  a367d2b

  Copy full SHA for a367d2b

• add amazons reviews

  tcapelle

  committed
  96fe2cb

  Copy full SHA for 96fe2cb

• amazon nb

  tcapelle

  committed
  c272b52

  Copy full SHA for c272b52

• fix category

  tcapelle

  committed
  bcbc136

  Copy full SHA for bcbc136

• update nb

  tcapelle

  committed
  c60ec70

  Copy full SHA for c60ec70

• helpful reviews

  tcapelle

  committed
  8367d77

  Copy full SHA for 8367d77

• save load JSONL

  tcapelle

  committed
  6c2242d

  Copy full SHA for 6c2242d

• listify

  tcapelle

  committed
  3565670

  Copy full SHA for 3565670

• update nb

  tcapelle

  committed
  6e1d0e7

  Copy full SHA for 6e1d0e7

Commits on Oct 31, 2024

• dataset creation

  tcapelle

  committed
  db6d421

  Copy full SHA for db6d421

• annotate reviews

  tcapelle

  committed
  5df5381

  Copy full SHA for 5df5381

• some renames

  tcapelle

  committed
  d34dc6b

  Copy full SHA for d34dc6b

• move main to test

  tcapelle

  committed
  54e873b

  Copy full SHA for 54e873b

• add tests to utils

  tcapelle

  committed
  02ef5fa

  Copy full SHA for 02ef5fa

• test and refactor formatter

  tcapelle

  committed
  c6a0554

  Copy full SHA for c6a0554

• refactor LLM

  tcapelle

  committed
  b3af223

  Copy full SHA for b3af223

• fix reqs

  tcapelle

  committed
  768ca2c

  Copy full SHA for 768ca2c

• fix litellm integration

  tcapelle

  committed
  b238d86

  Copy full SHA for b238d86

• add autopep

  tcapelle

  committed
  fa8289f

  Copy full SHA for fa8289f

• lint

  tcapelle

  committed
  1c08677

  Copy full SHA for 1c08677

Commits on Nov 5, 2024

• move prompts to file

  tcapelle

  committed
  d6122bd

  Copy full SHA for d6122bd

• refactor to use BaseModel instead of Tuple

  tcapelle

  committed
  56bc141

  Copy full SHA for 56bc141

• refactor logging

  tcapelle

  committed
  8bcaab8

  Copy full SHA for 8bcaab8

• rename fit

  tcapelle

  committed
  472dd34

  Copy full SHA for 472dd34

• refactor prompts and assertions

  tcapelle

  committed
  9cb136f

  Copy full SHA for 9cb136f

• add mini example for debug

  tcapelle

  committed
  3e40021

  Copy full SHA for 3e40021

• rename default LLM

  tcapelle

  committed
  6bdfd0f

  Copy full SHA for 6bdfd0f

Commits on Nov 6, 2024

• add a better dataset

  tcapelle

  committed
  1004d06

  Copy full SHA for 1004d06

• working refactor!

  tcapelle

  committed
  0f93bd1

  Copy full SHA for 0f93bd1

• large dataset!

  tcapelle

  committed
  0662005

  Copy full SHA for 0662005

• latest workiong nb

  tcapelle

  committed
  1930524

  Copy full SHA for 1930524

Commits on Nov 7, 2024

• nice logging

  tcapelle

  committed
  9afb1d9

  Copy full SHA for 9afb1d9

• 2 working examples

  tcapelle

  committed
  6a985f1

  Copy full SHA for 6a985f1

• add CLI, delete unused files

  tcapelle

  committed
  58ab3bd

  Copy full SHA for 58ab3bd

• improve readme

  tcapelle

  committed
  2d93a5e

  Copy full SHA for 2d93a5e

Commits on Nov 8, 2024

• auto detect data format

  tcapelle

  committed
  0b84abd

  Copy full SHA for 0b84abd

• add mini data

  tcapelle

  committed
  4fc9f42

  Copy full SHA for 4fc9f42

• add review eval py script

  morganmcg1

  committed
  b5bba8a

  Copy full SHA for b5bba8a

• add review eval python script

  morganmcg1

  committed
  63fa45c

  Copy full SHA for 63fa45c

• Merge branch 'cape' of https://github.com/wandb/evalForge into cape

  morganmcg1

  committed
  246af10

  Copy full SHA for 246af10

• add bulk review evals python script.py

  morganmcg1

  committed
  dc3cc20

  Copy full SHA for dc3cc20

• missing deps

  tcapelle

  committed
  d1e6208

  Copy full SHA for d1e6208

• lint

  tcapelle

  committed
  60c1c44

  Copy full SHA for 60c1c44

• more lint

  tcapelle

  committed
  f115005

  Copy full SHA for f115005

• only lint on push

  tcapelle

  committed
  b207233

  Copy full SHA for b207233

• python 3.11

  tcapelle

  committed
  bb9480c

  Copy full SHA for bb9480c

• let's blackify them

  tcapelle

  committed
  36b6055

  Copy full SHA for 36b6055

• fix tests

  tcapelle

  committed
  2fb0dba

  Copy full SHA for 2fb0dba

• missing rich dep, remove tqdm

  tcapelle

  committed
  344caaa

  Copy full SHA for 344caaa

• pass wandb key

  tcapelle

  committed
  c13887e

  Copy full SHA for c13887e

• 50k reviews evals

  morganmcg1

  committed
  c3ac7fb

  Copy full SHA for c3ac7fb

• fix async test dep

  tcapelle

  committed
  12b8241

  Copy full SHA for 12b8241

• rename

  tcapelle

  committed
  1d515f8

  Copy full SHA for 1d515f8

• Merge branch 'cape' of https://github.com/wandb/evalForge into cape

  morganmcg1

  committed
  75c5665

  Copy full SHA for 75c5665

• add args to review evals script

  morganmcg1

  committed
  47deea8

  Copy full SHA for 47deea8

• push 50k review evals

  morganmcg1

  committed
  2eb5236

  Copy full SHA for 2eb5236

• cassetes...

  tcapelle

  committed
  79bf3b9

  Copy full SHA for 79bf3b9

Commits on Nov 19, 2024

• update to mini

  tcapelle

  committed
  6869fff

  Copy full SHA for 6869fff