Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

transformer encoder layer output deos not seem right! #802

Open
hoseinbehrad opened this issue Jan 12, 2024 · 0 comments
Open

transformer encoder layer output deos not seem right! #802

hoseinbehrad opened this issue Jan 12, 2024 · 0 comments

Comments

@hoseinbehrad
Copy link

hoseinbehrad commented Jan 12, 2024

Hi. I was watching the video on 08. PyTorch Paper Replicating and also running code from 08_pytorch_paper_replicating_exercise_solutions.ipynb.
However when in the Excersice 1, 2.TransformerEncoderLayer section, the result are not generated I believe, or model is not trained.

I ran the solution notebook, but again the results are not the same.

The result from the video on 08. PyTorch Paper Replicating (time = 38:05)
1

The result from re-running the exact same code (from 08_pytorch_paper_replicating_exercise_solutions.ipynb)
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant