Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproduction of numbers #1

Open
nomisto opened this issue Oct 8, 2024 · 1 comment
Open

Reproduction of numbers #1

nomisto opened this issue Oct 8, 2024 · 1 comment

Comments

@nomisto
Copy link

nomisto commented Oct 8, 2024

I've cloned the repository and downloaded the models and data. How can I reproduce the CQDA numbers for e.g. 2i?

I tried:

PYTHONPATH=. python cli/cq
da-cli.py --checkpoint_path "./models/fb15k-237-betae/" --
do_test --data_path data/FB15k-237-betae --negative_sample_size 1 --hidden_dim 1000 --gamma 12.0 --batch_size 2000 
--test_batch_size 2000 --learning_rate 0.1 --cpu_num 0 --save_path models/fb15k-237-betae --max_steps 100000 --warm
_up_steps 9999999 --save_checkpoint_steps 50000 --valid_steps 2000 --log_steps 500 --test_log_steps 1000 --nentity 
14505 --nrelation 474 --geo cqd --print_on_screen --reg_weight 0.1 --optimizer adagrad --cqd-type discrete --cqd-t-
norm prod --cqd-k 5 --cqd-sigmoid-normalize-scores --use-qa-iterator --tasks 2i --seed 0 --beta_mode "(1600,2)" --b
ox_mode "(none,0.02)" --prefix None --evaluate_union DNF --score-transform deep --score-transform-hidden 1000 --sco
re-transform-input spo

However these do not get the correct results. (Most of the parameters come from the config.json). Am I missing something?

@nomisto
Copy link
Author

nomisto commented Oct 9, 2024

Unfortunately the paper does not mention what batch size e.g. was used, would you please be so kind to release the used commands/parameters @pminervini?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant