Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't reproduce accuracy numbers in "Structured data learning with TabTransformer" #2016

Open
rama100 opened this issue Dec 26, 2024 · 0 comments
Assignees

Comments

@rama100
Copy link

rama100 commented Dec 26, 2024

In Structured data learning with TabTransformer, we have the following:

  • The baseline linear model achieves ~81% validation accuracy.
  • The TabTransformer model achieves ~85% validation accuracy.

I ran the colab as-is with no modifications and the accuracy numbers don't match the above - I get 83.78% and 82.8% for the baseline and the TabTransformer model respectively i.e. the TabTransformer underperforms the baseline :-(.

(If random seeds had been set in the notebook, perhaps this could be avoided)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants