Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How is the explicit_prompts.json generated? I can't find it on the user documentation. #4

Open
zixian-wu opened this issue Oct 24, 2024 · 1 comment

Comments

@zixian-wu
Copy link

How is the explicit_prompts.json generated? I can't find it on the user documentation.

@FanqingM
Copy link
Collaborator

FanqingM commented Oct 25, 2024

Hello, The test prompt is prompts.json, while explicit_captions.json is to evaluate rewriting prompt in Discussion (Appendix. D). Where has 'Specifically, we rewrite the original prompts using GPT, adding expected physical outcomes and processes. For example, after “A bottle of juice is slowly poured out in the space station, releasing the liquid into the surrounding area”, we add “The liquid forms floating globules, spreading out and moving randomly through the air.” in the end.'
We also use explicit captions in Key Sequence Verification. stage of evaluation framework. The prompt to generate these we will update it ASAP.
But You can directly use explicit_captions.json for evaluation, it is also what we used for evaluation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants