Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Results are not reproducible at all #2

Open
CubicQubit opened this issue Nov 16, 2021 · 2 comments
Open

Results are not reproducible at all #2

CubicQubit opened this issue Nov 16, 2021 · 2 comments

Comments

@CubicQubit
Copy link

I was able able to run the code perfectly but the hyperparameters given for mTAN-full do not achieve 0.858 AUROC on physionet2012. The highest is AUROC ~0.827 with AUPRC ~0.45.

This is achieved with this command:
python3 tan_classification.py --alpha 100 --niters 300 --lr 0.0001 --batch-size 50 --rec-hidden 256 --gen-hidden 50 --latent-dim 20 --enc mtan_rnn --dec mtan_rnn --n 8000 --quantization 0.016 --save 1 --classif --norm --kl --learn-emb --k-iwae 1 --dataset physionet

@satyanshukla
Copy link
Collaborator

Could you please post the training logs here?

@CodeNinjaja
Copy link

Could you please post the training logs here?

I also encounter the question. I've attached the training log below.
mtan.log

I am looking forward to hearing back from you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants