Skip to content

Pull requests: huggingface/evaluate

New pull request New
Clear current search query, filters, and sorts
66 Open 290 Closed
66 Open 290 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add keras callback
#182 opened Jul 11, 2022 by lvwerra • Draft
5
Refactor perplexity so compute() does not run inference by default
#252 opened Aug 12, 2022 by mathemakitten • Draft
1
13
Customize Gradio Interface that is Launched
#298 opened Sep 22, 2022 by abidlabs Loading…
2
Allow EvaluationSuite to receive a Preprocessor
#366 opened Nov 18, 2022 by NimaBoscarino Loading…
2
Allow EvaluationSuite to receive a custom Evaluator
#367 opened Nov 18, 2022 by NimaBoscarino Loading…
4
fix outputs of WER/CER
#381 opened Dec 8, 2022 by lvwerra Loading…
4
Scikit-learn integration
#383 opened Dec 8, 2022 by lvwerra Loading…
9
[feature] use comet model from a local path
#390 opened Dec 21, 2022 by k-blo Loading…
7
[WIP] Add Panoptic Quality (PQ)
#408 opened Jan 30, 2023 by NielsRogge • Draft
2 tasks
7
Normalize exact match and F1 Score
#409 opened Feb 1, 2023 by avinashsai Loading…
1
2
ANLS metric
#413 opened Feb 4, 2023 by QuadV Loading…
10
Add pyarrow
#429 opened Mar 9, 2023 by fabaff Loading…
1
Correct a typo in sari.py
#430 opened Mar 16, 2023 by felixonmars Loading…
2
Fix incorrect error instructing to "pip install sklearn"
#436 opened Mar 24, 2023 by dongreenberg Loading…
1
3
Fix a bit typo in docs README
#439 opened Mar 31, 2023 by guspan-tanadi Loading…
2
Add kendall tau distance (not as a submodule)
#446 opened Apr 13, 2023 by unna97 Loading…
3
Add the support to pass a pre-loaded model and a pre-loaded tokenizer
#448 opened Apr 19, 2023 by JulesGM Loading…
feat: custom evaluator and metric name to support llm evaluation #433
#459 opened May 15, 2023 by fecet Loading…
[doc build] Use secrets
#468 opened Jun 9, 2023 by mishig25 Loading…
Fix mean computation in Mahalanobis distance
#471 opened Jul 12, 2023 by j0ma Loading…
Fix SQuAD v2 metric docs on references format
#474 opened Jul 18, 2023 by bryant1410 Loading…
Fix formatting of model names in radar plot
#479 opened Jul 29, 2023 by potamides Loading…
Adding tokenizer_id to perplexity evaluation
#482 opened Aug 4, 2023 by Albertoimpl Loading…
3
Add support for glue metric in EvaluationSuite
#488 opened Aug 25, 2023 by tybrs Loading…
1
when using custom models for perplexity metrix, support trust_remote_code
#496 opened Sep 13, 2023 by winglian Loading…
ProTip! Updated in the last three days: updated:>2025-03-07.