Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CWQ Ground Truth #21

Open
amayuelas opened this issue Aug 2, 2024 · 1 comment
Open

CWQ Ground Truth #21

amayuelas opened this issue Aug 2, 2024 · 1 comment

Comments

@amayuelas
Copy link

Where did you obtain the ground truth answers for the CWQ dataset?
I just reran the provided SPARQL queries on my installation of Freebase and I am getting 81.11% answers correct.
Shouldn't I be getting 100%?
@GasolSun36
Copy link
Owner

Where did you obtain the ground truth answers for the CWQ dataset? I just reran the provided SPARQL queries on my installation of Freebase and I am getting 81.11% answers correct. Shouldn't I be getting 100%?

You can get ground truth answers of CWQ dataset on the official website. Moreover, I think it's definitely need 100% correct, maybe you can talk to @Tanglumy for more information.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@amayuelas @GasolSun36