Skip to content
This repository has been archived by the owner on Jan 9, 2024. It is now read-only.

dynamically select how many passages to use for generating answer using relevance score #330

Open
vkehfdl1 opened this issue Nov 29, 2023 · 0 comments

Comments

@vkehfdl1
Copy link
Contributor

There are unrelated passages from top-k passages. If so, it will be not good for final answer result, also waste of input tokens.
So, we can drop some passages using relevance score.

The simple idea is only use passages in top 1-sigma. or other n-sigma rules.
You can strict threshold count for dropping passage.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant