-
Notifications
You must be signed in to change notification settings - Fork 285
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] env.append_transform #2040
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2040
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New FailureAs of commit 0b4228b with merge base 247ed6e ( NEW FAILURE - The following job has failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
Name | Max | Mean | Ops | Ops on Repo HEAD
|
Change |
---|---|---|---|---|---|
test_single | 89.0642ms | 88.6820ms | 11.2762 Ops/s | 11.3109 Ops/s | |
test_sync | 83.8182ms | 83.1355ms | 12.0285 Ops/s | 12.0140 Ops/s | |
test_async | 0.1610s | 68.6604ms | 14.5644 Ops/s | 14.7810 Ops/s | |
test_single_pixels | 98.9707ms | 98.7197ms | 10.1297 Ops/s | 10.0782 Ops/s | |
test_sync_pixels | 64.6208ms | 63.1644ms | 15.8317 Ops/s | 15.5490 Ops/s | |
test_async_pixels | 0.1188s | 53.4548ms | 18.7074 Ops/s | 16.9596 Ops/s | |
test_simple | 0.6813s | 0.6122s | 1.6335 Ops/s | 1.6413 Ops/s | |
test_transformed | 0.8602s | 0.7957s | 1.2567 Ops/s | 1.2496 Ops/s | |
test_serial | 1.9183s | 1.8613s | 0.5372 Ops/s | 0.5372 Ops/s | |
test_parallel | 1.6983s | 1.6346s | 0.6118 Ops/s | 0.6052 Ops/s | |
test_step_mdp_speed[True-True-True-True-True] | 65.1010μs | 25.5732μs | 39.1034 KOps/s | 37.4846 KOps/s | |
test_step_mdp_speed[True-True-True-True-False] | 30.0110μs | 15.9813μs | 62.5730 KOps/s | 61.7445 KOps/s | |
test_step_mdp_speed[True-True-True-False-True] | 39.0210μs | 14.8368μs | 67.4002 KOps/s | 66.4456 KOps/s | |
test_step_mdp_speed[True-True-True-False-False] | 25.3010μs | 9.2265μs | 108.3833 KOps/s | 106.8368 KOps/s | |
test_step_mdp_speed[True-True-False-True-True] | 48.9410μs | 27.2125μs | 36.7479 KOps/s | 35.7999 KOps/s | |
test_step_mdp_speed[True-True-False-True-False] | 35.6110μs | 17.3969μs | 57.4817 KOps/s | 56.7830 KOps/s | |
test_step_mdp_speed[True-True-False-False-True] | 41.2010μs | 16.3726μs | 61.0776 KOps/s | 59.2056 KOps/s | |
test_step_mdp_speed[True-True-False-False-False] | 31.2410μs | 11.0408μs | 90.5729 KOps/s | 92.4559 KOps/s | |
test_step_mdp_speed[True-False-True-True-True] | 52.9910μs | 29.3824μs | 34.0340 KOps/s | 33.9348 KOps/s | |
test_step_mdp_speed[True-False-True-True-False] | 35.2210μs | 19.0778μs | 52.4170 KOps/s | 52.9088 KOps/s | |
test_step_mdp_speed[True-False-True-False-True] | 44.1120μs | 16.3422μs | 61.1914 KOps/s | 61.5996 KOps/s | |
test_step_mdp_speed[True-False-True-False-False] | 29.9010μs | 10.7861μs | 92.7122 KOps/s | 91.7957 KOps/s | |
test_step_mdp_speed[True-False-False-True-True] | 47.4820μs | 30.6937μs | 32.5799 KOps/s | 32.4086 KOps/s | |
test_step_mdp_speed[True-False-False-True-False] | 36.0100μs | 20.9174μs | 47.8071 KOps/s | 48.7873 KOps/s | |
test_step_mdp_speed[True-False-False-False-True] | 41.9510μs | 17.9124μs | 55.8274 KOps/s | 56.1216 KOps/s | |
test_step_mdp_speed[True-False-False-False-False] | 28.3910μs | 12.3694μs | 80.8447 KOps/s | 79.5742 KOps/s | |
test_step_mdp_speed[False-True-True-True-True] | 46.1320μs | 29.1772μs | 34.2733 KOps/s | 34.6040 KOps/s | |
test_step_mdp_speed[False-True-True-True-False] | 38.3710μs | 19.1189μs | 52.3042 KOps/s | 51.8009 KOps/s | |
test_step_mdp_speed[False-True-True-False-True] | 35.8920μs | 19.3036μs | 51.8038 KOps/s | 48.9925 KOps/s | |
test_step_mdp_speed[False-True-True-False-False] | 38.0610μs | 12.1528μs | 82.2854 KOps/s | 79.5001 KOps/s | |
test_step_mdp_speed[False-True-False-True-True] | 55.1910μs | 30.3620μs | 32.9359 KOps/s | 32.4094 KOps/s | |
test_step_mdp_speed[False-True-False-True-False] | 36.5400μs | 20.7458μs | 48.2026 KOps/s | 47.8149 KOps/s | |
test_step_mdp_speed[False-True-False-False-True] | 37.1320μs | 20.4580μs | 48.8806 KOps/s | 48.5470 KOps/s | |
test_step_mdp_speed[False-True-False-False-False] | 28.5610μs | 13.8238μs | 72.3388 KOps/s | 71.8566 KOps/s | |
test_step_mdp_speed[False-False-True-True-True] | 52.3910μs | 32.4355μs | 30.8304 KOps/s | 30.7631 KOps/s | |
test_step_mdp_speed[False-False-True-True-False] | 38.5610μs | 22.4268μs | 44.5895 KOps/s | 44.8167 KOps/s | |
test_step_mdp_speed[False-False-True-False-True] | 45.5610μs | 20.6158μs | 48.5065 KOps/s | 48.4563 KOps/s | |
test_step_mdp_speed[False-False-True-False-False] | 39.8220μs | 13.8798μs | 72.0470 KOps/s | 71.9269 KOps/s | |
test_step_mdp_speed[False-False-False-True-True] | 50.8310μs | 33.4000μs | 29.9401 KOps/s | 30.0127 KOps/s | |
test_step_mdp_speed[False-False-False-True-False] | 49.3810μs | 23.9396μs | 41.7719 KOps/s | 41.5240 KOps/s | |
test_step_mdp_speed[False-False-False-False-True] | 36.3020μs | 21.9544μs | 45.5490 KOps/s | 44.9186 KOps/s | |
test_step_mdp_speed[False-False-False-False-False] | 30.6110μs | 15.1713μs | 65.9139 KOps/s | 65.2111 KOps/s | |
test_values[generalized_advantage_estimate-True-True] | 21.4941ms | 20.6799ms | 48.3562 Ops/s | 48.9649 Ops/s | |
test_values[vec_generalized_advantage_estimate-True-True] | 79.3881ms | 3.1168ms | 320.8428 Ops/s | 318.3337 Ops/s | |
test_values[td0_return_estimate-False-False] | 90.2620μs | 59.1450μs | 16.9076 KOps/s | 17.0575 KOps/s | |
test_values[td1_return_estimate-False-False] | 49.7691ms | 46.7474ms | 21.3916 Ops/s | 21.5816 Ops/s | |
test_values[vec_td1_return_estimate-False-False] | 2.0869ms | 1.7169ms | 582.4315 Ops/s | 582.1338 Ops/s | |
test_values[td_lambda_return_estimate-True-False] | 79.7948ms | 77.2857ms | 12.9390 Ops/s | 13.4623 Ops/s | |
test_values[vec_td_lambda_return_estimate-True-False] | 1.9737ms | 1.7010ms | 587.8819 Ops/s | 586.5190 Ops/s | |
test_gae_speed[generalized_advantage_estimate-False-1-512] | 20.8417ms | 20.4753ms | 48.8394 Ops/s | 48.9569 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.8430ms | 0.6369ms | 1.5700 KOps/s | 1.5804 KOps/s | |
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.6688ms | 0.5951ms | 1.6805 KOps/s | 1.6729 KOps/s | |
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.5662ms | 1.4041ms | 712.2225 Ops/s | 714.7946 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.9055ms | 0.6236ms | 1.6036 KOps/s | 1.6019 KOps/s | |
test_dqn_speed | 7.8916ms | 1.3019ms | 768.1056 Ops/s | 797.3994 Ops/s | |
test_ddpg_speed | 2.8690ms | 2.4835ms | 402.6505 Ops/s | 417.2668 Ops/s | |
test_sac_speed | 7.7720ms | 7.2544ms | 137.8482 Ops/s | 139.0473 Ops/s | |
test_redq_speed | 10.4404ms | 9.7507ms | 102.5568 Ops/s | 104.9981 Ops/s | |
test_redq_deprec_speed | 10.9721ms | 10.3675ms | 96.4551 Ops/s | 100.2632 Ops/s | |
test_td3_speed | 7.3636ms | 7.2339ms | 138.2387 Ops/s | 138.4076 Ops/s | |
test_cql_speed | 0.1150s | 26.3572ms | 37.9403 Ops/s | 42.4863 Ops/s | |
test_a2c_speed | 5.5703ms | 5.3529ms | 186.8154 Ops/s | 193.3805 Ops/s | |
test_ppo_speed | 5.9458ms | 5.6690ms | 176.3987 Ops/s | 181.3357 Ops/s | |
test_reinforce_speed | 4.7000ms | 4.3520ms | 229.7820 Ops/s | 237.1897 Ops/s | |
test_iql_speed | 19.5244ms | 18.9192ms | 52.8564 Ops/s | 53.2423 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 2.6071ms | 2.4919ms | 401.2924 Ops/s | 402.1537 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.0897ms | 0.5251ms | 1.9045 KOps/s | 1.9048 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7105ms | 0.5069ms | 1.9727 KOps/s | 1.9915 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 2.8115ms | 2.5482ms | 392.4385 Ops/s | 398.0543 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.1626ms | 0.5168ms | 1.9349 KOps/s | 1.9504 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6909ms | 0.4976ms | 2.0096 KOps/s | 2.0109 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 4.5969ms | 1.3531ms | 739.0433 Ops/s | 754.4488 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.4584ms | 1.2715ms | 786.5012 Ops/s | 799.6835 Ops/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 2.7572ms | 2.6352ms | 379.4797 Ops/s | 382.1264 Ops/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.7624ms | 0.6276ms | 1.5935 KOps/s | 1.5795 KOps/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 6.3541ms | 0.6182ms | 1.6175 KOps/s | 1.6096 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 2.5999ms | 2.5132ms | 397.9053 Ops/s | 403.9066 Ops/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.6427ms | 0.5156ms | 1.9393 KOps/s | 1.9147 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 4.6795ms | 0.5054ms | 1.9784 KOps/s | 1.9865 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 2.7788ms | 2.5546ms | 391.4488 Ops/s | 400.8312 Ops/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.3013ms | 0.5101ms | 1.9605 KOps/s | 1.9317 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7016ms | 0.4973ms | 2.0107 KOps/s | 2.0183 KOps/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 2.8040ms | 2.6239ms | 381.1166 Ops/s | 383.7313 Ops/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.7453ms | 0.6288ms | 1.5904 KOps/s | 1.5693 KOps/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 4.9057ms | 0.6189ms | 1.6157 KOps/s | 1.6023 KOps/s | |
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1265s | 6.7160ms | 148.8973 Ops/s | 148.2612 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 14.3314ms | 11.8827ms | 84.1560 Ops/s | 83.8720 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 6.4508ms | 1.1698ms | 854.8160 Ops/s | 931.6194 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1151s | 8.6859ms | 115.1287 Ops/s | 114.7191 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 14.1830ms | 11.8296ms | 84.5334 Ops/s | 83.4780 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 6.0145ms | 1.1583ms | 863.3282 Ops/s | 853.1877 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1147s | 6.7942ms | 147.1840 Ops/s | 146.5248 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 14.8111ms | 12.2607ms | 81.5617 Ops/s | 81.1424 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 6.2562ms | 1.5151ms | 660.0291 Ops/s | 659.6332 Ops/s |
|
Name | Max | Mean | Ops | Ops on Repo HEAD
|
Change |
---|---|---|---|---|---|
test_single | 51.5517ms | 50.9477ms | 19.6280 Ops/s | 17.8976 Ops/s | |
test_sync | 31.2395ms | 28.5958ms | 34.9702 Ops/s | 30.4410 Ops/s | |
test_async | 53.0033ms | 27.0975ms | 36.9037 Ops/s | 38.5826 Ops/s | |
test_simple | 0.3322s | 0.3290s | 3.0400 Ops/s | 2.9789 Ops/s | |
test_transformed | 0.5492s | 0.4813s | 2.0777 Ops/s | 2.0921 Ops/s | |
test_serial | 1.2585s | 1.1892s | 0.8409 Ops/s | 0.8196 Ops/s | |
test_parallel | 1.0553s | 0.9982s | 1.0018 Ops/s | 0.9947 Ops/s | |
test_step_mdp_speed[True-True-True-True-True] | 0.1744ms | 21.4207μs | 46.6838 KOps/s | 47.5793 KOps/s | |
test_step_mdp_speed[True-True-True-True-False] | 44.5120μs | 12.8714μs | 77.6913 KOps/s | 78.1381 KOps/s | |
test_step_mdp_speed[True-True-True-False-True] | 42.0980μs | 12.4814μs | 80.1194 KOps/s | 80.6652 KOps/s | |
test_step_mdp_speed[True-True-True-False-False] | 30.0460μs | 7.4843μs | 133.6133 KOps/s | 133.4087 KOps/s | |
test_step_mdp_speed[True-True-False-True-True] | 58.0470μs | 22.4994μs | 44.4457 KOps/s | 44.8898 KOps/s | |
test_step_mdp_speed[True-True-False-True-False] | 0.1019ms | 14.2874μs | 69.9916 KOps/s | 71.7085 KOps/s | |
test_step_mdp_speed[True-True-False-False-True] | 47.2580μs | 13.7189μs | 72.8923 KOps/s | 74.8328 KOps/s | |
test_step_mdp_speed[True-True-False-False-False] | 49.6620μs | 8.7570μs | 114.1941 KOps/s | 116.1151 KOps/s | |
test_step_mdp_speed[True-False-True-True-True] | 58.4480μs | 24.0166μs | 41.6379 KOps/s | 42.7382 KOps/s | |
test_step_mdp_speed[True-False-True-True-False] | 49.9430μs | 15.4214μs | 64.8448 KOps/s | 65.6377 KOps/s | |
test_step_mdp_speed[True-False-True-False-True] | 44.3220μs | 13.7877μs | 72.5283 KOps/s | 74.3838 KOps/s | |
test_step_mdp_speed[True-False-True-False-False] | 60.1810μs | 8.6973μs | 114.9778 KOps/s | 116.5174 KOps/s | |
test_step_mdp_speed[True-False-False-True-True] | 52.4080μs | 24.9426μs | 40.0921 KOps/s | 40.8821 KOps/s | |
test_step_mdp_speed[True-False-False-True-False] | 55.9840μs | 16.5989μs | 60.2450 KOps/s | 61.0102 KOps/s | |
test_step_mdp_speed[True-False-False-False-True] | 48.1690μs | 14.7940μs | 67.5949 KOps/s | 69.3842 KOps/s | |
test_step_mdp_speed[True-False-False-False-False] | 91.4900μs | 9.8836μs | 101.1779 KOps/s | 101.7487 KOps/s | |
test_step_mdp_speed[False-True-True-True-True] | 65.4520μs | 23.8151μs | 41.9901 KOps/s | 42.8668 KOps/s | |
test_step_mdp_speed[False-True-True-True-False] | 53.7100μs | 15.3652μs | 65.0820 KOps/s | 63.8090 KOps/s | |
test_step_mdp_speed[False-True-True-False-True] | 52.1060μs | 15.9654μs | 62.6353 KOps/s | 64.8674 KOps/s | |
test_step_mdp_speed[False-True-True-False-False] | 27.8420μs | 10.0252μs | 99.7482 KOps/s | 101.9667 KOps/s | |
test_step_mdp_speed[False-True-False-True-True] | 36.5880μs | 25.4491μs | 39.2941 KOps/s | 40.5453 KOps/s | |
test_step_mdp_speed[False-True-False-True-False] | 51.1950μs | 16.5811μs | 60.3097 KOps/s | 61.3995 KOps/s | |
test_step_mdp_speed[False-True-False-False-True] | 66.5540μs | 17.1232μs | 58.4004 KOps/s | 60.1670 KOps/s | |
test_step_mdp_speed[False-True-False-False-False] | 49.7220μs | 11.1171μs | 89.9516 KOps/s | 91.1043 KOps/s | |
test_step_mdp_speed[False-False-True-True-True] | 59.8610μs | 26.4788μs | 37.7660 KOps/s | 38.7497 KOps/s | |
test_step_mdp_speed[False-False-True-True-False] | 50.4630μs | 17.8842μs | 55.9153 KOps/s | 57.0397 KOps/s | |
test_step_mdp_speed[False-False-True-False-True] | 58.9590μs | 17.0260μs | 58.7338 KOps/s | 60.1080 KOps/s | |
test_step_mdp_speed[False-False-True-False-False] | 40.3850μs | 11.1719μs | 89.5104 KOps/s | 90.8669 KOps/s | |
test_step_mdp_speed[False-False-False-True-True] | 64.3390μs | 27.2205μs | 36.7371 KOps/s | 37.0453 KOps/s | |
test_step_mdp_speed[False-False-False-True-False] | 48.9110μs | 18.9081μs | 52.8874 KOps/s | 53.8035 KOps/s | |
test_step_mdp_speed[False-False-False-False-True] | 54.4710μs | 17.8718μs | 55.9541 KOps/s | 55.4702 KOps/s | |
test_step_mdp_speed[False-False-False-False-False] | 48.5200μs | 12.0765μs | 82.8052 KOps/s | 83.4698 KOps/s | |
test_values[generalized_advantage_estimate-True-True] | 10.4818ms | 9.5960ms | 104.2100 Ops/s | 102.2698 Ops/s | |
test_values[vec_generalized_advantage_estimate-True-True] | 36.1434ms | 33.5620ms | 29.7956 Ops/s | 28.1622 Ops/s | |
test_values[td0_return_estimate-False-False] | 0.2512ms | 0.1759ms | 5.6839 KOps/s | 5.4175 KOps/s | |
test_values[td1_return_estimate-False-False] | 23.8372ms | 23.3814ms | 42.7690 Ops/s | 41.9637 Ops/s | |
test_values[vec_td1_return_estimate-False-False] | 48.4477ms | 34.1728ms | 29.2631 Ops/s | 28.0566 Ops/s | |
test_values[td_lambda_return_estimate-True-False] | 36.6307ms | 33.9270ms | 29.4751 Ops/s | 29.4590 Ops/s | |
test_values[vec_td_lambda_return_estimate-True-False] | 35.0666ms | 33.5700ms | 29.7885 Ops/s | 28.0543 Ops/s | |
test_gae_speed[generalized_advantage_estimate-False-1-512] | 10.4858ms | 8.1566ms | 122.6006 Ops/s | 122.9755 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 2.4336ms | 2.0096ms | 497.6096 Ops/s | 496.8530 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.5434ms | 0.3460ms | 2.8902 KOps/s | 2.8938 KOps/s | |
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 45.6281ms | 43.8703ms | 22.7945 Ops/s | 22.4043 Ops/s | |
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.7033ms | 3.0687ms | 325.8745 Ops/s | 328.9683 Ops/s | |
test_dqn_speed | 3.9825ms | 1.3512ms | 740.0938 Ops/s | 742.4386 Ops/s | |
test_ddpg_speed | 3.3711ms | 2.6917ms | 371.5178 Ops/s | 375.2116 Ops/s | |
test_sac_speed | 10.0836ms | 8.3823ms | 119.2989 Ops/s | 120.1541 Ops/s | |
test_redq_speed | 14.4304ms | 13.3731ms | 74.7772 Ops/s | 74.0259 Ops/s | |
test_redq_deprec_speed | 15.7288ms | 13.5338ms | 73.8893 Ops/s | 73.9737 Ops/s | |
test_td3_speed | 8.3155ms | 8.1028ms | 123.4137 Ops/s | 121.3414 Ops/s | |
test_cql_speed | 0.1199s | 39.2844ms | 25.4554 Ops/s | 27.3631 Ops/s | |
test_a2c_speed | 8.4912ms | 7.4357ms | 134.4858 Ops/s | 127.4307 Ops/s | |
test_ppo_speed | 9.2931ms | 7.7503ms | 129.0278 Ops/s | 126.2405 Ops/s | |
test_reinforce_speed | 7.7907ms | 6.6413ms | 150.5724 Ops/s | 147.8508 Ops/s | |
test_iql_speed | 33.6154ms | 32.6417ms | 30.6357 Ops/s | 30.3095 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 2.6309ms | 2.3785ms | 420.4348 Ops/s | 410.1239 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.9064ms | 0.4901ms | 2.0403 KOps/s | 1.7176 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6661ms | 0.4688ms | 2.1329 KOps/s | 2.0482 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.3326ms | 2.2951ms | 435.7060 Ops/s | 393.0040 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.9940ms | 0.4878ms | 2.0502 KOps/s | 1.9971 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.8895ms | 0.4705ms | 2.1255 KOps/s | 2.0739 KOps/s | |
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 1.6905ms | 1.2059ms | 829.2824 Ops/s | 817.2979 Ops/s | |
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.3182ms | 1.1336ms | 882.1408 Ops/s | 863.9413 Ops/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 3.5171ms | 2.3874ms | 418.8600 Ops/s | 393.1762 Ops/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.0552ms | 0.6041ms | 1.6554 KOps/s | 1.6225 KOps/s | |
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 1.0417ms | 0.5846ms | 1.7107 KOps/s | 1.6752 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 3.4803ms | 2.2833ms | 437.9638 Ops/s | 405.6906 Ops/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.9117ms | 0.4923ms | 2.0314 KOps/s | 1.9680 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.9140ms | 0.4760ms | 2.1009 KOps/s | 2.0444 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 2.4877ms | 2.2723ms | 440.0832 Ops/s | 395.7987 Ops/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.5996ms | 0.4832ms | 2.0696 KOps/s | 2.0042 KOps/s | |
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 3.5175ms | 0.4676ms | 2.1386 KOps/s | 2.0894 KOps/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 2.6017ms | 2.4005ms | 416.5759 Ops/s | 389.5210 Ops/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.1000ms | 0.6076ms | 1.6458 KOps/s | 1.6086 KOps/s | |
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.7469ms | 0.5842ms | 1.7119 KOps/s | 1.6762 KOps/s | |
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1109s | 7.9176ms | 126.3004 Ops/s | 116.0627 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 14.4413ms | 12.0701ms | 82.8496 Ops/s | 81.1116 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 3.7728ms | 1.1156ms | 896.4083 Ops/s | 962.8075 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1050s | 5.6457ms | 177.1266 Ops/s | 169.9264 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 14.3298ms | 12.0279ms | 83.1403 Ops/s | 81.7460 Ops/s | |
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 3.7244ms | 1.1040ms | 905.8292 Ops/s | 957.1065 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1124s | 8.3386ms | 119.9235 Ops/s | 116.8904 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 15.3187ms | 12.7299ms | 78.5551 Ops/s | 78.6543 Ops/s | |
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 1.9200ms | 1.3567ms | 737.0569 Ops/s | 670.7708 Ops/s |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
CLA Signed
This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
enhancement
New feature or request
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.