Definition of Optimizer in train function

[GeondoPark]

Hi,
First of all, Thank you so much for sharing the code.

Maybe because of my lack of knowledge, I wonder that is there any difference between declaring an optimizer every epoch and declaring once at the start of training?
In code, the declaration of optimization is in train function!

Thank you!