Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarification on inst_category meanings and chart type details #13

Open
zhaochen0110 opened this issue Jan 8, 2025 · 2 comments
Open

Comments

@zhaochen0110
Copy link

Hi there,

First of all, thank you for the wonderful work! I’ve been using the dataset and noticed the following format:

{
    "figure_id": 2,
    "query": "What is the name of the line that is the furthest away from its fi value from the W_H axis?",
    "answer": "lambda_L = 0.13",
    "inst_category": 1,
    "qa_source": 3
},

I see that inst_category has four possible values (1, 2, 3, 4). Could you please clarify what each of these categories represents?

Additionally, I noticed that while the dataset mentions charxiv and the charts it covers, it doesn’t specify the exact types of those charts. Would it be possible to provide the specific location or documentation that explains these chart types in more detail?

Thank you so much for your time and help!

@zwcolin
Copy link
Member

zwcolin commented Jan 8, 2025

hi Zhaochen,

they correspond to text in chart, text in general, number in chart and number in general respectively.

you can look for src/constants.py for details e.g., prompts, instructions

as for chart types, we have the metadata json but probably haven't updated the codebase to aggregate results based on chart types, as we only had them during its paper rebuttal.

could you drop me an email for your needs? i'm happy to figure it out with you!

@zhaochen0110
Copy link
Author

Thanks for your response!

Here is my email: [email protected]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants