Skip to content

Commit

Permalink
Merge pull request #683 from egecandrsn/patch-1
Browse files Browse the repository at this point in the history
Update 08_pytorch_paper_replicating.ipynb
  • Loading branch information
mrdbourke committed Oct 17, 2023
2 parents bd84150 + 7435131 commit 17f6c98
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion 08_pytorch_paper_replicating.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -2373,7 +2373,7 @@
"4. Creating a `PatchEmbedding` layer (the one we made in section 4.5) with a `patch_size=16` and `embedding_dim=768` (from Table 1 for ViT-Base).\n",
"5. Passing the single image through the `PatchEmbedding` layer in 4 to create a sequence of patch embeddings.\n",
"6. Creating a class token embedding like in section 4.6. \n",
"7. Prepending the class token emebdding to the patch embeddings created in step 5.\n",
"7. Prepending the class token embedding to the patch embeddings created in step 5.\n",
"8. Creating a position embedding like in section 4.7.\n",
"9. Adding the position embedding to the class token and patch embeddings created in step 7.\n",
"\n",
Expand Down

0 comments on commit 17f6c98

Please sign in to comment.