Skip to content

Activity

Showing most recent first

Merge pull request #30 from simekent/patch-1

Pull request merge
mlabonnepushed 2 commits to master • 6f1e0ef…eca2992 • 
on May 7, 2024

add use_chat_template to lighteval

mlabonnepushed 1 commit to master • c419032…6f1e0ef • 
on Apr 20, 2024

dtype=float16

mlabonnepushed 1 commit to master • 8dae3e4…c419032 • 
on Apr 18, 2024

add optional HF login

mlabonnepushed 1 commit to master • 7f00053…8dae3e4 • 
on Apr 16, 2024

Merge pull request #26 from mlabonne/eqbench

Pull request merge
mlabonnepushed 4 commits to master • f396921…7f00053 • 
on Apr 4, 2024

rename results to evals

mlabonnepushed 1 commit to eqbench • 7e583d5…ba55b76 • 
on Apr 4, 2024

fix directory and table

mlabonnepushed 1 commit to eqbench • db9158b…7e583d5 • 
on Apr 4, 2024

fix eq-bench table

mlabonnecreated eqbench • db9158b • 
on Apr 4, 2024

fix eq-bench table

mlabonnecreated openllm-fix • db9158b • 
on Mar 29, 2024

Deleted branch

mlabonnedeleted feature/fasttokenizer • 
on Mar 29, 2024

Deleted branch

mlabonnedeleted openllm-fix • 
on Mar 29, 2024

Merge pull request #24 from mlabonne/openllm-fix

Pull request merge
mlabonnepushed 11 commits to master • 3285cfc…f396921 • 
on Mar 29, 2024

remove lm-evaluation-harness

mlabonnepushed 1 commit to openllm-fix • f59d421…cd40d60 • 
on Mar 29, 2024

revert changes make_table

mlabonnepushed 1 commit to openllm-fix • 528f0ca…f59d421 • 
on Mar 29, 2024

upgrade make_table

mlabonnepushed 1 commit to openllm-fix • 53f10e5…528f0ca • 
on Mar 29, 2024

fix gsm8k and reposition average in summary table

mlabonnepushed 1 commit to openllm-fix • e3a9999…53f10e5 • 
on Mar 29, 2024

fix get version

mlabonnepushed 1 commit to openllm-fix • a80cdf8…e3a9999 • 
on Mar 28, 2024

add mmlu in table

mlabonnepushed 1 commit to openllm-fix • 2b97655…a80cdf8 • 
on Mar 28, 2024

remove gpu_memory_utilization

mlabonnepushed 1 commit to openllm-fix • 310e4c5…2b97655 • 
on Mar 28, 2024

install lm-evaluation-harness

mlabonnepushed 1 commit to openllm-fix • eb1b4b9…310e4c5 • 
on Mar 28, 2024

ah yes I forgot to call the script

mlabonnepushed 1 commit to openllm-fix • 1e7d897…eb1b4b9 • 
on Mar 28, 2024

remove vllm for openllm benchmark

mlabonnepushed 1 commit to openllm-fix • 3285cfc…1e7d897 • 
on Mar 28, 2024

specify version for huggingface_hub

mlabonnecreated openllm-fix • 3285cfc • 
on Mar 28, 2024

specify version for huggingface_hub

mlabonnepushed 1 commit to master • 732f3b2…3285cfc • 
on Mar 25, 2024

add huggingface_hub requirement

mlabonnepushed 1 commit to master • a7dcb8f…732f3b2 • 
on Mar 25, 2024

fix lighteval error when not using lighteval

mlabonnepushed 1 commit to master • 4776746…a7dcb8f • 
on Mar 25, 2024

Changed links in the readme

mlabonnepushed 1 commit to master • af4bdca…4776746 • 
on Mar 25, 2024

added triu_tril_cuda_template in troubleshooting

mlabonnepushed 1 commit to master • e6ed76e…af4bdca • 
on Mar 25, 2024

Update with lighteval

mlabonnepushed 1 commit to master • 8b54211…e6ed76e • 
on Mar 22, 2024

Merge pull request #19 from burtenshaw/master

Pull request merge
mlabonnepushed 8 commits to master • 8fc8026…8b54211 • 
on Mar 22, 2024