Skip to content

Commit

Permalink
Merge pull request #108 from sallyom/update-readme
Browse files Browse the repository at this point in the history
update README
  • Loading branch information
nathan-weinberg authored Aug 28, 2024
2 parents ec709c7 + 0dc0321 commit b48144f
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,8 @@ Python Library for Evaluation

## MT-Bench / MT-Bench-Branch Testing Steps

> **⚠️ Note:** Must use Python version 3.10 or later.
```shell
# Optional: Use cloud-instance.sh (https://github.com/instructlab/instructlab/tree/main/scripts/infra) to launch and setup the instance
scripts/infra/cloud-instance.sh ec2 launch -t g5.4xlarge
Expand All @@ -34,6 +36,7 @@ In another shell window

```shell
export INSTRUCTLAB_EVAL_FIRST_N_QUESTIONS=10 # Optional if you want to shorten run times
# Commands relative to eval directory
python3 tests/test_gen_answers.py
python3 tests/test_branch_gen_answers.py
```
Expand Down Expand Up @@ -104,4 +107,4 @@ eval_output/
└── reference_answer
└── instructlab
└── granite-7b-lab.jsonl
```
```

0 comments on commit b48144f

Please sign in to comment.