Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

accuracy needs some more features #38

Open
Trondtr opened this issue May 8, 2024 · 0 comments
Open

accuracy needs some more features #38

Trondtr opened this issue May 8, 2024 · 0 comments

Comments

@Trondtr
Copy link

Trondtr commented May 8, 2024

Thanks for a good tool in accuracy, as described under Speller testing in the README file. In order to be really useful for development, the tool needs some additional options:

Sorting order

Today, we may sort by input order (default) and by time used. All well. In addition, we need:

Sort by Result, both in the order given here and in the reversed order (with 6 on top)

  1. Top result
  2. Suggestion 1
  3. Suggestion 2
  4. ...
  5. Not in suggestions
  6. Not in suggestions (No suggestion)

Other features

We need Average position for all suggestions.

The old setup also calculated precision, recall and accuracy, this was a useful feature.

Tweaking output

The initial "Speller configuration" is good to have stated. I might have missed it, but it is not clear to me how to manipulate it. Based on the documentation I tried

3 divvunspell (main)$ accuracy -w 5 -o support/accuracy-viewer/public/report.json ../../giellalt/lang-fit/test/data/typos.txt ../../giellalt/lang-fit/tools/spellcheckers/fit.zhfst

... but that still resulted in 10 suggestions, not 5.

Summary

The most important thing is top be able to sort by result, it is critical for improving the suggestion mechanism. The other issues are there for making better reports.

And then, of course the inclusion of this in an easier command setup in each lang-xxx catalogue, but for my own part I am happy with the present setup, as soon as I get these features in place.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant