Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] env.append_transform #2040

Merged
merged 3 commits into from
Mar 26, 2024
Merged

[Feature] env.append_transform #2040

merged 3 commits into from
Mar 26, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Mar 25, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 25, 2024 •
edited

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2040

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure

As of commit 0b4228b with merge base 247ed6e (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 25, 2024
@github-actions GitHub Actions
Copy link

github-actions bot commented Mar 25, 2024 •
edited

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}2$. Worsened: $\large\color{#d91a1a}2$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 89.0642ms 88.6820ms 11.2762 Ops/s 11.3109 Ops/s $\color{#d91a1a}-0.31\%$
test_sync 83.8182ms 83.1355ms 12.0285 Ops/s 12.0140 Ops/s $\color{#35bf28}+0.12\%$
test_async 0.1610s 68.6604ms 14.5644 Ops/s 14.7810 Ops/s $\color{#d91a1a}-1.47\%$
test_single_pixels 98.9707ms 98.7197ms 10.1297 Ops/s 10.0782 Ops/s $\color{#35bf28}+0.51\%$
test_sync_pixels 64.6208ms 63.1644ms 15.8317 Ops/s 15.5490 Ops/s $\color{#35bf28}+1.82\%$
test_async_pixels 0.1188s 53.4548ms 18.7074 Ops/s 16.9596 Ops/s $\textbf{\color{#35bf28}+10.31\%}$
test_simple 0.6813s 0.6122s 1.6335 Ops/s 1.6413 Ops/s $\color{#d91a1a}-0.47\%$
test_transformed 0.8602s 0.7957s 1.2567 Ops/s 1.2496 Ops/s $\color{#35bf28}+0.57\%$
test_serial 1.9183s 1.8613s 0.5372 Ops/s 0.5372 Ops/s $\color{#35bf28}+0.02\%$
test_parallel 1.6983s 1.6346s 0.6118 Ops/s 0.6052 Ops/s $\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-True-True-True] 65.1010μs 25.5732μs 39.1034 KOps/s 37.4846 KOps/s $\color{#35bf28}+4.32\%$
test_step_mdp_speed[True-True-True-True-False] 30.0110μs 15.9813μs 62.5730 KOps/s 61.7445 KOps/s $\color{#35bf28}+1.34\%$
test_step_mdp_speed[True-True-True-False-True] 39.0210μs 14.8368μs 67.4002 KOps/s 66.4456 KOps/s $\color{#35bf28}+1.44\%$
test_step_mdp_speed[True-True-True-False-False] 25.3010μs 9.2265μs 108.3833 KOps/s 106.8368 KOps/s $\color{#35bf28}+1.45\%$
test_step_mdp_speed[True-True-False-True-True] 48.9410μs 27.2125μs 36.7479 KOps/s 35.7999 KOps/s $\color{#35bf28}+2.65\%$
test_step_mdp_speed[True-True-False-True-False] 35.6110μs 17.3969μs 57.4817 KOps/s 56.7830 KOps/s $\color{#35bf28}+1.23\%$
test_step_mdp_speed[True-True-False-False-True] 41.2010μs 16.3726μs 61.0776 KOps/s 59.2056 KOps/s $\color{#35bf28}+3.16\%$
test_step_mdp_speed[True-True-False-False-False] 31.2410μs 11.0408μs 90.5729 KOps/s 92.4559 KOps/s $\color{#d91a1a}-2.04\%$
test_step_mdp_speed[True-False-True-True-True] 52.9910μs 29.3824μs 34.0340 KOps/s 33.9348 KOps/s $\color{#35bf28}+0.29\%$
test_step_mdp_speed[True-False-True-True-False] 35.2210μs 19.0778μs 52.4170 KOps/s 52.9088 KOps/s $\color{#d91a1a}-0.93\%$
test_step_mdp_speed[True-False-True-False-True] 44.1120μs 16.3422μs 61.1914 KOps/s 61.5996 KOps/s $\color{#d91a1a}-0.66\%$
test_step_mdp_speed[True-False-True-False-False] 29.9010μs 10.7861μs 92.7122 KOps/s 91.7957 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-False-False-True-True] 47.4820μs 30.6937μs 32.5799 KOps/s 32.4086 KOps/s $\color{#35bf28}+0.53\%$
test_step_mdp_speed[True-False-False-True-False] 36.0100μs 20.9174μs 47.8071 KOps/s 48.7873 KOps/s $\color{#d91a1a}-2.01\%$
test_step_mdp_speed[True-False-False-False-True] 41.9510μs 17.9124μs 55.8274 KOps/s 56.1216 KOps/s $\color{#d91a1a}-0.52\%$
test_step_mdp_speed[True-False-False-False-False] 28.3910μs 12.3694μs 80.8447 KOps/s 79.5742 KOps/s $\color{#35bf28}+1.60\%$
test_step_mdp_speed[False-True-True-True-True] 46.1320μs 29.1772μs 34.2733 KOps/s 34.6040 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[False-True-True-True-False] 38.3710μs 19.1189μs 52.3042 KOps/s 51.8009 KOps/s $\color{#35bf28}+0.97\%$
test_step_mdp_speed[False-True-True-False-True] 35.8920μs 19.3036μs 51.8038 KOps/s 48.9925 KOps/s $\textbf{\color{#35bf28}+5.74\%}$
test_step_mdp_speed[False-True-True-False-False] 38.0610μs 12.1528μs 82.2854 KOps/s 79.5001 KOps/s $\color{#35bf28}+3.50\%$
test_step_mdp_speed[False-True-False-True-True] 55.1910μs 30.3620μs 32.9359 KOps/s 32.4094 KOps/s $\color{#35bf28}+1.62\%$
test_step_mdp_speed[False-True-False-True-False] 36.5400μs 20.7458μs 48.2026 KOps/s 47.8149 KOps/s $\color{#35bf28}+0.81\%$
test_step_mdp_speed[False-True-False-False-True] 37.1320μs 20.4580μs 48.8806 KOps/s 48.5470 KOps/s $\color{#35bf28}+0.69\%$
test_step_mdp_speed[False-True-False-False-False] 28.5610μs 13.8238μs 72.3388 KOps/s 71.8566 KOps/s $\color{#35bf28}+0.67\%$
test_step_mdp_speed[False-False-True-True-True] 52.3910μs 32.4355μs 30.8304 KOps/s 30.7631 KOps/s $\color{#35bf28}+0.22\%$
test_step_mdp_speed[False-False-True-True-False] 38.5610μs 22.4268μs 44.5895 KOps/s 44.8167 KOps/s $\color{#d91a1a}-0.51\%$
test_step_mdp_speed[False-False-True-False-True] 45.5610μs 20.6158μs 48.5065 KOps/s 48.4563 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-False-True-False-False] 39.8220μs 13.8798μs 72.0470 KOps/s 71.9269 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[False-False-False-True-True] 50.8310μs 33.4000μs 29.9401 KOps/s 30.0127 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-False-False-True-False] 49.3810μs 23.9396μs 41.7719 KOps/s 41.5240 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-False-False-False-True] 36.3020μs 21.9544μs 45.5490 KOps/s 44.9186 KOps/s $\color{#35bf28}+1.40\%$
test_step_mdp_speed[False-False-False-False-False] 30.6110μs 15.1713μs 65.9139 KOps/s 65.2111 KOps/s $\color{#35bf28}+1.08\%$
test_values[generalized_advantage_estimate-True-True] 21.4941ms 20.6799ms 48.3562 Ops/s 48.9649 Ops/s $\color{#d91a1a}-1.24\%$
test_values[vec_generalized_advantage_estimate-True-True] 79.3881ms 3.1168ms 320.8428 Ops/s 318.3337 Ops/s $\color{#35bf28}+0.79\%$
test_values[td0_return_estimate-False-False] 90.2620μs 59.1450μs 16.9076 KOps/s 17.0575 KOps/s $\color{#d91a1a}-0.88\%$
test_values[td1_return_estimate-False-False] 49.7691ms 46.7474ms 21.3916 Ops/s 21.5816 Ops/s $\color{#d91a1a}-0.88\%$
test_values[vec_td1_return_estimate-False-False] 2.0869ms 1.7169ms 582.4315 Ops/s 582.1338 Ops/s $\color{#35bf28}+0.05\%$
test_values[td_lambda_return_estimate-True-False] 79.7948ms 77.2857ms 12.9390 Ops/s 13.4623 Ops/s $\color{#d91a1a}-3.89\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.9737ms 1.7010ms 587.8819 Ops/s 586.5190 Ops/s $\color{#35bf28}+0.23\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 20.8417ms 20.4753ms 48.8394 Ops/s 48.9569 Ops/s $\color{#d91a1a}-0.24\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8430ms 0.6369ms 1.5700 KOps/s 1.5804 KOps/s $\color{#d91a1a}-0.66\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.6688ms 0.5951ms 1.6805 KOps/s 1.6729 KOps/s $\color{#35bf28}+0.45\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5662ms 1.4041ms 712.2225 Ops/s 714.7946 Ops/s $\color{#d91a1a}-0.36\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9055ms 0.6236ms 1.6036 KOps/s 1.6019 KOps/s $\color{#35bf28}+0.10\%$
test_dqn_speed 7.8916ms 1.3019ms 768.1056 Ops/s 797.3994 Ops/s $\color{#d91a1a}-3.67\%$
test_ddpg_speed 2.8690ms 2.4835ms 402.6505 Ops/s 417.2668 Ops/s $\color{#d91a1a}-3.50\%$
test_sac_speed 7.7720ms 7.2544ms 137.8482 Ops/s 139.0473 Ops/s $\color{#d91a1a}-0.86\%$
test_redq_speed 10.4404ms 9.7507ms 102.5568 Ops/s 104.9981 Ops/s $\color{#d91a1a}-2.33\%$
test_redq_deprec_speed 10.9721ms 10.3675ms 96.4551 Ops/s 100.2632 Ops/s $\color{#d91a1a}-3.80\%$
test_td3_speed 7.3636ms 7.2339ms 138.2387 Ops/s 138.4076 Ops/s $\color{#d91a1a}-0.12\%$
test_cql_speed 0.1150s 26.3572ms 37.9403 Ops/s 42.4863 Ops/s $\textbf{\color{#d91a1a}-10.70\%}$
test_a2c_speed 5.5703ms 5.3529ms 186.8154 Ops/s 193.3805 Ops/s $\color{#d91a1a}-3.39\%$
test_ppo_speed 5.9458ms 5.6690ms 176.3987 Ops/s 181.3357 Ops/s $\color{#d91a1a}-2.72\%$
test_reinforce_speed 4.7000ms 4.3520ms 229.7820 Ops/s 237.1897 Ops/s $\color{#d91a1a}-3.12\%$
test_iql_speed 19.5244ms 18.9192ms 52.8564 Ops/s 53.2423 Ops/s $\color{#d91a1a}-0.72\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.6071ms 2.4919ms 401.2924 Ops/s 402.1537 Ops/s $\color{#d91a1a}-0.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0897ms 0.5251ms 1.9045 KOps/s 1.9048 KOps/s $\color{#d91a1a}-0.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7105ms 0.5069ms 1.9727 KOps/s 1.9915 KOps/s $\color{#d91a1a}-0.94\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.8115ms 2.5482ms 392.4385 Ops/s 398.0543 Ops/s $\color{#d91a1a}-1.41\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1626ms 0.5168ms 1.9349 KOps/s 1.9504 KOps/s $\color{#d91a1a}-0.79\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6909ms 0.4976ms 2.0096 KOps/s 2.0109 KOps/s $\color{#d91a1a}-0.06\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 4.5969ms 1.3531ms 739.0433 Ops/s 754.4488 Ops/s $\color{#d91a1a}-2.04\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4584ms 1.2715ms 786.5012 Ops/s 799.6835 Ops/s $\color{#d91a1a}-1.65\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.7572ms 2.6352ms 379.4797 Ops/s 382.1264 Ops/s $\color{#d91a1a}-0.69\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7624ms 0.6276ms 1.5935 KOps/s 1.5795 KOps/s $\color{#35bf28}+0.88\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 6.3541ms 0.6182ms 1.6175 KOps/s 1.6096 KOps/s $\color{#35bf28}+0.49\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.5999ms 2.5132ms 397.9053 Ops/s 403.9066 Ops/s $\color{#d91a1a}-1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6427ms 0.5156ms 1.9393 KOps/s 1.9147 KOps/s $\color{#35bf28}+1.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 4.6795ms 0.5054ms 1.9784 KOps/s 1.9865 KOps/s $\color{#d91a1a}-0.41\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.7788ms 2.5546ms 391.4488 Ops/s 400.8312 Ops/s $\color{#d91a1a}-2.34\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.3013ms 0.5101ms 1.9605 KOps/s 1.9317 KOps/s $\color{#35bf28}+1.49\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7016ms 0.4973ms 2.0107 KOps/s 2.0183 KOps/s $\color{#d91a1a}-0.37\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.8040ms 2.6239ms 381.1166 Ops/s 383.7313 Ops/s $\color{#d91a1a}-0.68\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7453ms 0.6288ms 1.5904 KOps/s 1.5693 KOps/s $\color{#35bf28}+1.34\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.9057ms 0.6189ms 1.6157 KOps/s 1.6023 KOps/s $\color{#35bf28}+0.83\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1265s 6.7160ms 148.8973 Ops/s 148.2612 Ops/s $\color{#35bf28}+0.43\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.3314ms 11.8827ms 84.1560 Ops/s 83.8720 Ops/s $\color{#35bf28}+0.34\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 6.4508ms 1.1698ms 854.8160 Ops/s 931.6194 Ops/s $\textbf{\color{#d91a1a}-8.24\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1151s 8.6859ms 115.1287 Ops/s 114.7191 Ops/s $\color{#35bf28}+0.36\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.1830ms 11.8296ms 84.5334 Ops/s 83.4780 Ops/s $\color{#35bf28}+1.26\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 6.0145ms 1.1583ms 863.3282 Ops/s 853.1877 Ops/s $\color{#35bf28}+1.19\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1147s 6.7942ms 147.1840 Ops/s 146.5248 Ops/s $\color{#35bf28}+0.45\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 14.8111ms 12.2607ms 81.5617 Ops/s 81.1424 Ops/s $\color{#35bf28}+0.52\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 6.2562ms 1.5151ms 660.0291 Ops/s 659.6332 Ops/s $\color{#35bf28}+0.06\%$

@vmoens vmoens added the enhancement New feature or request label Mar 25, 2024
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}13$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 51.5517ms 50.9477ms 19.6280 Ops/s 17.8976 Ops/s $\textbf{\color{#35bf28}+9.67\%}$
test_sync 31.2395ms 28.5958ms 34.9702 Ops/s 30.4410 Ops/s $\textbf{\color{#35bf28}+14.88\%}$
test_async 53.0033ms 27.0975ms 36.9037 Ops/s 38.5826 Ops/s $\color{#d91a1a}-4.35\%$
test_simple 0.3322s 0.3290s 3.0400 Ops/s 2.9789 Ops/s $\color{#35bf28}+2.05\%$
test_transformed 0.5492s 0.4813s 2.0777 Ops/s 2.0921 Ops/s $\color{#d91a1a}-0.69\%$
test_serial 1.2585s 1.1892s 0.8409 Ops/s 0.8196 Ops/s $\color{#35bf28}+2.60\%$
test_parallel 1.0553s 0.9982s 1.0018 Ops/s 0.9947 Ops/s $\color{#35bf28}+0.72\%$
test_step_mdp_speed[True-True-True-True-True] 0.1744ms 21.4207μs 46.6838 KOps/s 47.5793 KOps/s $\color{#d91a1a}-1.88\%$
test_step_mdp_speed[True-True-True-True-False] 44.5120μs 12.8714μs 77.6913 KOps/s 78.1381 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[True-True-True-False-True] 42.0980μs 12.4814μs 80.1194 KOps/s 80.6652 KOps/s $\color{#d91a1a}-0.68\%$
test_step_mdp_speed[True-True-True-False-False] 30.0460μs 7.4843μs 133.6133 KOps/s 133.4087 KOps/s $\color{#35bf28}+0.15\%$
test_step_mdp_speed[True-True-False-True-True] 58.0470μs 22.4994μs 44.4457 KOps/s 44.8898 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[True-True-False-True-False] 0.1019ms 14.2874μs 69.9916 KOps/s 71.7085 KOps/s $\color{#d91a1a}-2.39\%$
test_step_mdp_speed[True-True-False-False-True] 47.2580μs 13.7189μs 72.8923 KOps/s 74.8328 KOps/s $\color{#d91a1a}-2.59\%$
test_step_mdp_speed[True-True-False-False-False] 49.6620μs 8.7570μs 114.1941 KOps/s 116.1151 KOps/s $\color{#d91a1a}-1.65\%$
test_step_mdp_speed[True-False-True-True-True] 58.4480μs 24.0166μs 41.6379 KOps/s 42.7382 KOps/s $\color{#d91a1a}-2.57\%$
test_step_mdp_speed[True-False-True-True-False] 49.9430μs 15.4214μs 64.8448 KOps/s 65.6377 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[True-False-True-False-True] 44.3220μs 13.7877μs 72.5283 KOps/s 74.3838 KOps/s $\color{#d91a1a}-2.49\%$
test_step_mdp_speed[True-False-True-False-False] 60.1810μs 8.6973μs 114.9778 KOps/s 116.5174 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-False-False-True-True] 52.4080μs 24.9426μs 40.0921 KOps/s 40.8821 KOps/s $\color{#d91a1a}-1.93\%$
test_step_mdp_speed[True-False-False-True-False] 55.9840μs 16.5989μs 60.2450 KOps/s 61.0102 KOps/s $\color{#d91a1a}-1.25\%$
test_step_mdp_speed[True-False-False-False-True] 48.1690μs 14.7940μs 67.5949 KOps/s 69.3842 KOps/s $\color{#d91a1a}-2.58\%$
test_step_mdp_speed[True-False-False-False-False] 91.4900μs 9.8836μs 101.1779 KOps/s 101.7487 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-True-True-True-True] 65.4520μs 23.8151μs 41.9901 KOps/s 42.8668 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[False-True-True-True-False] 53.7100μs 15.3652μs 65.0820 KOps/s 63.8090 KOps/s $\color{#35bf28}+2.00\%$
test_step_mdp_speed[False-True-True-False-True] 52.1060μs 15.9654μs 62.6353 KOps/s 64.8674 KOps/s $\color{#d91a1a}-3.44\%$
test_step_mdp_speed[False-True-True-False-False] 27.8420μs 10.0252μs 99.7482 KOps/s 101.9667 KOps/s $\color{#d91a1a}-2.18\%$
test_step_mdp_speed[False-True-False-True-True] 36.5880μs 25.4491μs 39.2941 KOps/s 40.5453 KOps/s $\color{#d91a1a}-3.09\%$
test_step_mdp_speed[False-True-False-True-False] 51.1950μs 16.5811μs 60.3097 KOps/s 61.3995 KOps/s $\color{#d91a1a}-1.77\%$
test_step_mdp_speed[False-True-False-False-True] 66.5540μs 17.1232μs 58.4004 KOps/s 60.1670 KOps/s $\color{#d91a1a}-2.94\%$
test_step_mdp_speed[False-True-False-False-False] 49.7220μs 11.1171μs 89.9516 KOps/s 91.1043 KOps/s $\color{#d91a1a}-1.27\%$
test_step_mdp_speed[False-False-True-True-True] 59.8610μs 26.4788μs 37.7660 KOps/s 38.7497 KOps/s $\color{#d91a1a}-2.54\%$
test_step_mdp_speed[False-False-True-True-False] 50.4630μs 17.8842μs 55.9153 KOps/s 57.0397 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[False-False-True-False-True] 58.9590μs 17.0260μs 58.7338 KOps/s 60.1080 KOps/s $\color{#d91a1a}-2.29\%$
test_step_mdp_speed[False-False-True-False-False] 40.3850μs 11.1719μs 89.5104 KOps/s 90.8669 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[False-False-False-True-True] 64.3390μs 27.2205μs 36.7371 KOps/s 37.0453 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[False-False-False-True-False] 48.9110μs 18.9081μs 52.8874 KOps/s 53.8035 KOps/s $\color{#d91a1a}-1.70\%$
test_step_mdp_speed[False-False-False-False-True] 54.4710μs 17.8718μs 55.9541 KOps/s 55.4702 KOps/s $\color{#35bf28}+0.87\%$
test_step_mdp_speed[False-False-False-False-False] 48.5200μs 12.0765μs 82.8052 KOps/s 83.4698 KOps/s $\color{#d91a1a}-0.80\%$
test_values[generalized_advantage_estimate-True-True] 10.4818ms 9.5960ms 104.2100 Ops/s 102.2698 Ops/s $\color{#35bf28}+1.90\%$
test_values[vec_generalized_advantage_estimate-True-True] 36.1434ms 33.5620ms 29.7956 Ops/s 28.1622 Ops/s $\textbf{\color{#35bf28}+5.80\%}$
test_values[td0_return_estimate-False-False] 0.2512ms 0.1759ms 5.6839 KOps/s 5.4175 KOps/s $\color{#35bf28}+4.92\%$
test_values[td1_return_estimate-False-False] 23.8372ms 23.3814ms 42.7690 Ops/s 41.9637 Ops/s $\color{#35bf28}+1.92\%$
test_values[vec_td1_return_estimate-False-False] 48.4477ms 34.1728ms 29.2631 Ops/s 28.0566 Ops/s $\color{#35bf28}+4.30\%$
test_values[td_lambda_return_estimate-True-False] 36.6307ms 33.9270ms 29.4751 Ops/s 29.4590 Ops/s $\color{#35bf28}+0.05\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.0666ms 33.5700ms 29.7885 Ops/s 28.0543 Ops/s $\textbf{\color{#35bf28}+6.18\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 10.4858ms 8.1566ms 122.6006 Ops/s 122.9755 Ops/s $\color{#d91a1a}-0.30\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.4336ms 2.0096ms 497.6096 Ops/s 496.8530 Ops/s $\color{#35bf28}+0.15\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5434ms 0.3460ms 2.8902 KOps/s 2.8938 KOps/s $\color{#d91a1a}-0.12\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 45.6281ms 43.8703ms 22.7945 Ops/s 22.4043 Ops/s $\color{#35bf28}+1.74\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.7033ms 3.0687ms 325.8745 Ops/s 328.9683 Ops/s $\color{#d91a1a}-0.94\%$
test_dqn_speed 3.9825ms 1.3512ms 740.0938 Ops/s 742.4386 Ops/s $\color{#d91a1a}-0.32\%$
test_ddpg_speed 3.3711ms 2.6917ms 371.5178 Ops/s 375.2116 Ops/s $\color{#d91a1a}-0.98\%$
test_sac_speed 10.0836ms 8.3823ms 119.2989 Ops/s 120.1541 Ops/s $\color{#d91a1a}-0.71\%$
test_redq_speed 14.4304ms 13.3731ms 74.7772 Ops/s 74.0259 Ops/s $\color{#35bf28}+1.01\%$
test_redq_deprec_speed 15.7288ms 13.5338ms 73.8893 Ops/s 73.9737 Ops/s $\color{#d91a1a}-0.11\%$
test_td3_speed 8.3155ms 8.1028ms 123.4137 Ops/s 121.3414 Ops/s $\color{#35bf28}+1.71\%$
test_cql_speed 0.1199s 39.2844ms 25.4554 Ops/s 27.3631 Ops/s $\textbf{\color{#d91a1a}-6.97\%}$
test_a2c_speed 8.4912ms 7.4357ms 134.4858 Ops/s 127.4307 Ops/s $\textbf{\color{#35bf28}+5.54\%}$
test_ppo_speed 9.2931ms 7.7503ms 129.0278 Ops/s 126.2405 Ops/s $\color{#35bf28}+2.21\%$
test_reinforce_speed 7.7907ms 6.6413ms 150.5724 Ops/s 147.8508 Ops/s $\color{#35bf28}+1.84\%$
test_iql_speed 33.6154ms 32.6417ms 30.6357 Ops/s 30.3095 Ops/s $\color{#35bf28}+1.08\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.6309ms 2.3785ms 420.4348 Ops/s 410.1239 Ops/s $\color{#35bf28}+2.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9064ms 0.4901ms 2.0403 KOps/s 1.7176 KOps/s $\textbf{\color{#35bf28}+18.79\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6661ms 0.4688ms 2.1329 KOps/s 2.0482 KOps/s $\color{#35bf28}+4.14\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.3326ms 2.2951ms 435.7060 Ops/s 393.0040 Ops/s $\textbf{\color{#35bf28}+10.87\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9940ms 0.4878ms 2.0502 KOps/s 1.9971 KOps/s $\color{#35bf28}+2.66\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8895ms 0.4705ms 2.1255 KOps/s 2.0739 KOps/s $\color{#35bf28}+2.49\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6905ms 1.2059ms 829.2824 Ops/s 817.2979 Ops/s $\color{#35bf28}+1.47\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.3182ms 1.1336ms 882.1408 Ops/s 863.9413 Ops/s $\color{#35bf28}+2.11\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.5171ms 2.3874ms 418.8600 Ops/s 393.1762 Ops/s $\textbf{\color{#35bf28}+6.53\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0552ms 0.6041ms 1.6554 KOps/s 1.6225 KOps/s $\color{#35bf28}+2.03\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0417ms 0.5846ms 1.7107 KOps/s 1.6752 KOps/s $\color{#35bf28}+2.11\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.4803ms 2.2833ms 437.9638 Ops/s 405.6906 Ops/s $\textbf{\color{#35bf28}+7.96\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9117ms 0.4923ms 2.0314 KOps/s 1.9680 KOps/s $\color{#35bf28}+3.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9140ms 0.4760ms 2.1009 KOps/s 2.0444 KOps/s $\color{#35bf28}+2.76\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.4877ms 2.2723ms 440.0832 Ops/s 395.7987 Ops/s $\textbf{\color{#35bf28}+11.19\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.5996ms 0.4832ms 2.0696 KOps/s 2.0042 KOps/s $\color{#35bf28}+3.26\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 3.5175ms 0.4676ms 2.1386 KOps/s 2.0894 KOps/s $\color{#35bf28}+2.35\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.6017ms 2.4005ms 416.5759 Ops/s 389.5210 Ops/s $\textbf{\color{#35bf28}+6.95\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.1000ms 0.6076ms 1.6458 KOps/s 1.6086 KOps/s $\color{#35bf28}+2.31\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7469ms 0.5842ms 1.7119 KOps/s 1.6762 KOps/s $\color{#35bf28}+2.13\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1109s 7.9176ms 126.3004 Ops/s 116.0627 Ops/s $\textbf{\color{#35bf28}+8.82\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.4413ms 12.0701ms 82.8496 Ops/s 81.1116 Ops/s $\color{#35bf28}+2.14\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 3.7728ms 1.1156ms 896.4083 Ops/s 962.8075 Ops/s $\textbf{\color{#d91a1a}-6.90\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1050s 5.6457ms 177.1266 Ops/s 169.9264 Ops/s $\color{#35bf28}+4.24\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.3298ms 12.0279ms 83.1403 Ops/s 81.7460 Ops/s $\color{#35bf28}+1.71\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.7244ms 1.1040ms 905.8292 Ops/s 957.1065 Ops/s $\textbf{\color{#d91a1a}-5.36\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1124s 8.3386ms 119.9235 Ops/s 116.8904 Ops/s $\color{#35bf28}+2.59\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 15.3187ms 12.7299ms 78.5551 Ops/s 78.6543 Ops/s $\color{#d91a1a}-0.13\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.9200ms 1.3567ms 737.0569 Ops/s 670.7708 Ops/s $\textbf{\color{#35bf28}+9.88\%}$

@vmoens vmoens merged commit e57d0bc into main Mar 26, 2024
66 of 67 checks passed
@vmoens vmoens deleted the env.append_transform branch March 26, 2024 07:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
2 participants
@vmoens @facebook-github-bot