You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# initialize target model with same weights as the model, in case we load a model
#shouldn't this be done after load_model?
self.update_target_model()
if self.load_model:
self.model.load_weights("./save_model/cartpole_dqn.h5")
could be
if self.load_model:
self.model.load_weights("./save_model/cartpole_dqn.h5")
self.update_target_model()
so that if we load a saved model, the target_model would have the saved weights rather than starting with the Keras-initialized weights.
I'm going to test this but it seems like the loaded model would be using an inferior target_model for at least the first episode and the model weights could get adjusted in the wrong way in that first episode, slightly slowing down it's learning.
The text was updated successfully, but these errors were encountered:
could be
so that if we load a saved model, the target_model would have the saved weights rather than starting with the Keras-initialized weights.
I'm going to test this but it seems like the loaded model would be using an inferior
target_model
for at least the first episode and the model weights could get adjusted in the wrong way in that first episode, slightly slowing down it's learning.The text was updated successfully, but these errors were encountered: