We will release the full source code when the paper becomes public.
run sim_env.py
Then you should see something like this:
...
--------------------------------------------------------------------------------
Env step 1: 48 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 2: 105 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 3: 47 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 4: 60 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 5: 96 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 6: 102 -0.14583844 False {'elapsed': 0.0018153190612792969}
--------------------------------------------------------------------------------
Env step 7: 110 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 8: 55 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 9: 27 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 10: 74 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 11: 3 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 12: 91 -0.36971566 False {'elapsed': 0.0005257129669189453}
--------------------------------------------------------------------------------
Env step 13: 41 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 14: 56 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 15: 42 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 16: 44 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 17: 11 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 18: 85 -0.07546607 False {'elapsed': 0.0005056858062744141}
--------------------------------------------------------------------------------
Env step 19: 26 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 20: 117 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 21: 87 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 22: 62 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 23: 23 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 24: 45 -0.1947872 False {'elapsed': 0.0040264129638671875}
--------------------------------------------------------------------------------
Env step 25: 7 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 26: 9 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 27: 18 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 28: 78 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 29: 69 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 30: 52 -0.28977436 False {'elapsed': 0.003393411636352539}
--------------------------------------------------------------------------------
Env step 31: 77 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 32: 58 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 33: 108 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 34: 68 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 35: 43 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 36: 16 -0.3725164 False {'elapsed': 0.0011484622955322266}
--------------------------------------------------------------------------------
Env step 37: 104 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 38: 22 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 39: 5 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 40: 113 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 41: 35 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 42: 10 -0.2493555 False {'elapsed': 0.0004982948303222656}
--------------------------------------------------------------------------------
Env step 43: 29 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 44: 59 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 45: 86 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 46: 6 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 47: 39 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 48: 31 -0.435938 False {'elapsed': 0.000423431396484375}
--------------------------------------------------------------------------------
Env step 49: 51 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 50: 19 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 51: 79 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 52: 84 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 53: 97 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 54: 12 -0.024965465 False {'elapsed': 0.00042438507080078125}
--------------------------------------------------------------------------------
Env step 55: 25 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 56: 103 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 57: 80 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 58: 13 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 59: 0 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 60: 50 -0.43025208 False {'elapsed': 0.0004208087921142578}
--------------------------------------------------------------------------------
Env step 61: 95 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 62: 64 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 63: 70 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 64: 82 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 65: 8 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 66: 2 -0.3114438 False {'elapsed': 0.0004837512969970703}
--------------------------------------------------------------------------------
Env step 67: 112 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 68: 1 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 69: 17 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 70: 81 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 71: 100 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 72: 4 -0.4473639 False {'elapsed': 0.0004200935363769531}
--------------------------------------------------------------------------------
Env step 73: 46 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 74: 107 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 75: 118 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 76: 61 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 77: 38 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 78: 67 -0.14996868 False {'elapsed': 0.0005176067352294922}
--------------------------------------------------------------------------------
Env step 79: 36 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 80: 71 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 81: 30 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 82: 15 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 83: 109 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 84: 34 -0.15181524 False {'elapsed': 0.0005142688751220703}
--------------------------------------------------------------------------------
Env step 85: 33 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 86: 111 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 87: 93 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 88: 63 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 89: 75 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 90: 98 -0.14047438 False {'elapsed': 0.0005300045013427734}
--------------------------------------------------------------------------------
Env step 91: 114 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 92: 20 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 93: 119 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 94: 21 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 95: 89 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 96: 88 -0.408033 False {'elapsed': 0.0005161762237548828}
--------------------------------------------------------------------------------
Env step 97: 49 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 98: 40 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 99: 65 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 100: 24 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 101: 76 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 102: 99 -0.09984532 False {'elapsed': 0.0005154609680175781}
--------------------------------------------------------------------------------
Env step 103: 115 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 104: 73 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 105: 94 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 106: 32 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 107: 101 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 108: 37 -0.41168886 False {'elapsed': 0.0005218982696533203}
--------------------------------------------------------------------------------
Env step 109: 106 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 110: 53 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 111: 72 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 112: 66 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 113: 14 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 114: 57 -0.08952314 False {'elapsed': 0.0004868507385253906}
--------------------------------------------------------------------------------
Env step 115: 28 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 116: 83 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 117: 90 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 118: 54 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 119: 116 0.0 False {'elapsed': 0.0}
--------------------------------------------------------------------------------
Env step 120: 92 -0.17594624 True {'elapsed': 0.0004246234893798828}
Process finished with exit code 0