Deep-sarsa is the program with dynamic obstacles in which we are trying to extract q-value / weight updates. The default program deploys an untrained agent. To deploy a a trained agent, swtich "False" to "True" for self.load_model in line 20 of deep_sarsa_agent.py. For comparison, I included the regular sarsa program that successfully utilizes weight visualization. However, the obstacles in sarsa are stationary.
Credit: Hyeokreal