New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SPICE on another language? #13

Open

jontooy opened this issue Jan 19, 2022 · 0 comments

jontooy commented Jan 19, 2022

Hi all!

I want to do SPICE evaluation on Arabic Captions specifically. In the 'spice-1.0.jar' file there is a README file that says:

Dependencies

Stanford CoreNLP 3.6.0
Stanford Scene Graph Parser
Meteor 1.5 (for synset matching)

Since the the version of Stanford CoreNLP is not compatible with Arabic, I wonder if I can:

Replace Stanford Scene Graph Parser with the latest version, updated to work with CoreNLP 4.2.0
Replace CoreNLP 3.6.0 with 4.2.0 with Arabic models

I actually tried to download and replace these files in the COCO-caption API, but with no improved SPICE scores...

Do you think this task is possible or no?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment