New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question about accuracy rate threshold 0.5 #16

Open

StevenLau6 opened this issue Jan 5, 2025 · 1 comment

StevenLau6 commented Jan 5, 2025

Hi, thanks for open-source this great work.

Could you please explain why the accuracy rate thresholds of Verification Functions, Test Cases, and Responses are set as 0.5 instead of 1?

Thanks~

Contributor

dongguanting commented Jan 7, 2025

This is an empirical setup; otherwise, the final data volume would be very small.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment