Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Documentation] README rewrite and broken links #2023

Merged
merged 1 commit into from
Oct 11, 2024
Merged

[Documentation] README rewrite and broken links #2023

merged 1 commit into from
Oct 11, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Mar 19, 2024

No description provided.

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Mar 19, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2023

Note: Links to docs will display an error until the docs builds have been completed.

❌ 22 New Failures, 4 Unrelated Failures

As of commit b526707 with merge base 1f3a5e9 (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 19, 2024
@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}11$. Worsened: $\large\color{#d91a1a}4$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 57.9777ms 55.7489ms 17.9376 Ops/s 16.9048 Ops/s $\textbf{\color{#35bf28}+6.11\%}$
test_sync 43.0824ms 35.0418ms 28.5374 Ops/s 33.0567 Ops/s $\textbf{\color{#d91a1a}-13.67\%}$
test_async 65.2070ms 30.6451ms 32.6316 Ops/s 36.1725 Ops/s $\textbf{\color{#d91a1a}-9.79\%}$
test_simple 0.3861s 0.3391s 2.9489 Ops/s 2.9419 Ops/s $\color{#35bf28}+0.24\%$
test_transformed 0.4764s 0.4730s 2.1139 Ops/s 2.1376 Ops/s $\color{#d91a1a}-1.11\%$
test_serial 1.2594s 1.2071s 0.8284 Ops/s 0.8284 Ops/s $+0.00\%$
test_parallel 1.1084s 1.0539s 0.9488 Ops/s 0.9707 Ops/s $\color{#d91a1a}-2.25\%$
test_step_mdp_speed[True-True-True-True-True] 0.1582ms 21.7998μs 45.8720 KOps/s 46.6872 KOps/s $\color{#d91a1a}-1.75\%$
test_step_mdp_speed[True-True-True-True-False] 0.1246ms 13.2248μs 75.6153 KOps/s 76.8538 KOps/s $\color{#d91a1a}-1.61\%$
test_step_mdp_speed[True-True-True-False-True] 0.2354ms 14.8982μs 67.1220 KOps/s 79.6460 KOps/s $\textbf{\color{#d91a1a}-15.72\%}$
test_step_mdp_speed[True-True-True-False-False] 42.7490μs 7.9474μs 125.8281 KOps/s 125.1946 KOps/s $\color{#35bf28}+0.51\%$
test_step_mdp_speed[True-True-False-True-True] 0.1004ms 23.2023μs 43.0993 KOps/s 43.7381 KOps/s $\color{#d91a1a}-1.46\%$
test_step_mdp_speed[True-True-False-True-False] 49.0510μs 14.4618μs 69.1475 KOps/s 69.6890 KOps/s $\color{#d91a1a}-0.78\%$
test_step_mdp_speed[True-True-False-False-True] 49.6330μs 14.1154μs 70.8446 KOps/s 72.5073 KOps/s $\color{#d91a1a}-2.29\%$
test_step_mdp_speed[True-True-False-False-False] 42.6090μs 9.1640μs 109.1228 KOps/s 112.9555 KOps/s $\color{#d91a1a}-3.39\%$
test_step_mdp_speed[True-False-True-True-True] 71.9140μs 24.8103μs 40.3059 KOps/s 41.3110 KOps/s $\color{#d91a1a}-2.43\%$
test_step_mdp_speed[True-False-True-True-False] 44.4340μs 15.9415μs 62.7294 KOps/s 63.4823 KOps/s $\color{#d91a1a}-1.19\%$
test_step_mdp_speed[True-False-True-False-True] 38.7420μs 14.2988μs 69.9360 KOps/s 72.0696 KOps/s $\color{#d91a1a}-2.96\%$
test_step_mdp_speed[True-False-True-False-False] 28.4130μs 9.1000μs 109.8898 KOps/s 113.2135 KOps/s $\color{#d91a1a}-2.94\%$
test_step_mdp_speed[True-False-False-True-True] 80.1500μs 25.7951μs 38.7671 KOps/s 39.0909 KOps/s $\color{#d91a1a}-0.83\%$
test_step_mdp_speed[True-False-False-True-False] 58.3800μs 17.0691μs 58.5854 KOps/s 59.7416 KOps/s $\color{#d91a1a}-1.94\%$
test_step_mdp_speed[True-False-False-False-True] 44.8240μs 15.5162μs 64.4486 KOps/s 66.2369 KOps/s $\color{#d91a1a}-2.70\%$
test_step_mdp_speed[True-False-False-False-False] 66.8360μs 10.4320μs 95.8586 KOps/s 98.9069 KOps/s $\color{#d91a1a}-3.08\%$
test_step_mdp_speed[False-True-True-True-True] 83.6470μs 24.4339μs 40.9267 KOps/s 40.8860 KOps/s $\color{#35bf28}+0.10\%$
test_step_mdp_speed[False-True-True-True-False] 71.6340μs 16.0274μs 62.3933 KOps/s 63.3277 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-True-True-False-True] 48.6410μs 16.4515μs 60.7849 KOps/s 61.6109 KOps/s $\color{#d91a1a}-1.34\%$
test_step_mdp_speed[False-True-True-False-False] 63.4890μs 10.3946μs 96.2038 KOps/s 98.1792 KOps/s $\color{#d91a1a}-2.01\%$
test_step_mdp_speed[False-True-False-True-True] 41.4680μs 26.1739μs 38.2060 KOps/s 38.3801 KOps/s $\color{#d91a1a}-0.45\%$
test_step_mdp_speed[False-True-False-True-False] 54.1410μs 17.0390μs 58.6890 KOps/s 58.8994 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-True-False-False-True] 57.2270μs 17.7309μs 56.3986 KOps/s 57.5970 KOps/s $\color{#d91a1a}-2.08\%$
test_step_mdp_speed[False-True-False-False-False] 43.2600μs 11.5400μs 86.6554 KOps/s 87.9603 KOps/s $\color{#d91a1a}-1.48\%$
test_step_mdp_speed[False-False-True-True-True] 76.6670μs 26.8314μs 37.2697 KOps/s 37.4172 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[False-False-True-True-False] 43.7210μs 18.4310μs 54.2565 KOps/s 54.7316 KOps/s $\color{#d91a1a}-0.87\%$
test_step_mdp_speed[False-False-True-False-True] 74.7500μs 17.6543μs 56.6436 KOps/s 57.2340 KOps/s $\color{#d91a1a}-1.03\%$
test_step_mdp_speed[False-False-True-False-False] 70.1710μs 11.5410μs 86.6473 KOps/s 88.1326 KOps/s $\color{#d91a1a}-1.69\%$
test_step_mdp_speed[False-False-False-True-True] 71.2940μs 27.9493μs 35.7791 KOps/s 36.3377 KOps/s $\color{#d91a1a}-1.54\%$
test_step_mdp_speed[False-False-False-True-False] 74.1980μs 19.3720μs 51.6210 KOps/s 51.8960 KOps/s $\color{#d91a1a}-0.53\%$
test_step_mdp_speed[False-False-False-False-True] 42.3990μs 18.7772μs 53.2562 KOps/s 55.0056 KOps/s $\color{#d91a1a}-3.18\%$
test_step_mdp_speed[False-False-False-False-False] 59.0910μs 12.6362μs 79.1378 KOps/s 81.0931 KOps/s $\color{#d91a1a}-2.41\%$
test_values[generalized_advantage_estimate-True-True] 10.6700ms 9.4741ms 105.5511 Ops/s 107.9727 Ops/s $\color{#d91a1a}-2.24\%$
test_values[vec_generalized_advantage_estimate-True-True] 37.4906ms 33.4143ms 29.9273 Ops/s 28.3934 Ops/s $\textbf{\color{#35bf28}+5.40\%}$
test_values[td0_return_estimate-False-False] 0.2364ms 0.1662ms 6.0162 KOps/s 5.8029 KOps/s $\color{#35bf28}+3.68\%$
test_values[td1_return_estimate-False-False] 26.1372ms 23.5929ms 42.3857 Ops/s 42.6675 Ops/s $\color{#d91a1a}-0.66\%$
test_values[vec_td1_return_estimate-False-False] 36.6224ms 33.6819ms 29.6895 Ops/s 28.3708 Ops/s $\color{#35bf28}+4.65\%$
test_values[td_lambda_return_estimate-True-False] 36.6648ms 33.7444ms 29.6346 Ops/s 29.2075 Ops/s $\color{#35bf28}+1.46\%$
test_values[vec_td_lambda_return_estimate-True-False] 35.7078ms 33.5175ms 29.8351 Ops/s 27.9981 Ops/s $\textbf{\color{#35bf28}+6.56\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 10.1210ms 8.1693ms 122.4102 Ops/s 123.1978 Ops/s $\color{#d91a1a}-0.64\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 2.3868ms 1.9286ms 518.5051 Ops/s 494.6583 Ops/s $\color{#35bf28}+4.82\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5492ms 0.3518ms 2.8424 KOps/s 2.7951 KOps/s $\color{#35bf28}+1.69\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 50.3356ms 45.5210ms 21.9679 Ops/s 21.5715 Ops/s $\color{#35bf28}+1.84\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 3.1739ms 3.0119ms 332.0113 Ops/s 329.4090 Ops/s $\color{#35bf28}+0.79\%$
test_dqn_speed 1.6086ms 1.3769ms 726.2726 Ops/s 717.4913 Ops/s $\color{#35bf28}+1.22\%$
test_ddpg_speed 3.5536ms 2.7103ms 368.9659 Ops/s 364.7031 Ops/s $\color{#35bf28}+1.17\%$
test_sac_speed 12.1065ms 8.3324ms 120.0140 Ops/s 116.2922 Ops/s $\color{#35bf28}+3.20\%$
test_redq_speed 14.6140ms 13.0151ms 76.8339 Ops/s 75.3225 Ops/s $\color{#35bf28}+2.01\%$
test_redq_deprec_speed 14.8164ms 13.2503ms 75.4700 Ops/s 71.7018 Ops/s $\textbf{\color{#35bf28}+5.26\%}$
test_td3_speed 9.8471ms 8.2522ms 121.1800 Ops/s 118.2978 Ops/s $\color{#35bf28}+2.44\%$
test_cql_speed 37.0856ms 35.9579ms 27.8103 Ops/s 27.4257 Ops/s $\color{#35bf28}+1.40\%$
test_a2c_speed 8.5714ms 7.3189ms 136.6326 Ops/s 131.8979 Ops/s $\color{#35bf28}+3.59\%$
test_ppo_speed 9.5747ms 7.6445ms 130.8129 Ops/s 124.9657 Ops/s $\color{#35bf28}+4.68\%$
test_reinforce_speed 7.3620ms 6.5434ms 152.8266 Ops/s 149.7160 Ops/s $\color{#35bf28}+2.08\%$
test_iql_speed 0.1038s 34.7224ms 28.7999 Ops/s 30.2935 Ops/s $\color{#d91a1a}-4.93\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.3191ms 2.1462ms 465.9502 Ops/s 437.3070 Ops/s $\textbf{\color{#35bf28}+6.55\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6901ms 0.4982ms 2.0072 KOps/s 1.8386 KOps/s $\textbf{\color{#35bf28}+9.17\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.4910ms 0.4723ms 2.1175 KOps/s 2.1414 KOps/s $\color{#d91a1a}-1.11\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1416ms 2.1590ms 463.1683 Ops/s 467.0470 Ops/s $\color{#d91a1a}-0.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.8588ms 0.4862ms 2.0567 KOps/s 2.0506 KOps/s $\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6243ms 0.4645ms 2.1530 KOps/s 2.1600 KOps/s $\color{#d91a1a}-0.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.0125ms 1.2947ms 772.3744 Ops/s 773.2220 Ops/s $\color{#d91a1a}-0.11\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6541ms 1.2250ms 816.3014 Ops/s 815.7854 Ops/s $\color{#35bf28}+0.06\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.4361ms 2.2651ms 441.4799 Ops/s 446.5402 Ops/s $\color{#d91a1a}-1.13\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7113ms 0.6104ms 1.6381 KOps/s 1.6425 KOps/s $\color{#d91a1a}-0.26\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 3.7989ms 0.5859ms 1.7069 KOps/s 1.7161 KOps/s $\color{#d91a1a}-0.53\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 2.3584ms 2.1495ms 465.2330 Ops/s 448.0657 Ops/s $\color{#35bf28}+3.83\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6522ms 0.4999ms 2.0002 KOps/s 1.9767 KOps/s $\color{#35bf28}+1.19\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 3.7577ms 0.4769ms 2.0967 KOps/s 2.0351 KOps/s $\color{#35bf28}+3.02\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 2.5972ms 2.1520ms 464.6879 Ops/s 427.2003 Ops/s $\textbf{\color{#35bf28}+8.78\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.5886ms 0.4899ms 2.0411 KOps/s 1.9925 KOps/s $\color{#35bf28}+2.44\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6151ms 0.4649ms 2.1508 KOps/s 2.1093 KOps/s $\color{#35bf28}+1.97\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 2.7381ms 2.2625ms 441.9794 Ops/s 409.8961 Ops/s $\textbf{\color{#35bf28}+7.83\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0782ms 0.6120ms 1.6339 KOps/s 1.6045 KOps/s $\color{#35bf28}+1.83\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7765ms 0.5848ms 1.7100 KOps/s 1.6900 KOps/s $\color{#35bf28}+1.18\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 90.7539ms 7.0077ms 142.7010 Ops/s 133.7667 Ops/s $\textbf{\color{#35bf28}+6.68\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 14.8272ms 12.0544ms 82.9576 Ops/s 82.7283 Ops/s $\color{#35bf28}+0.28\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.7692ms 1.0471ms 955.0167 Ops/s 952.5637 Ops/s $\color{#35bf28}+0.26\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 86.3987ms 5.3328ms 187.5173 Ops/s 144.3005 Ops/s $\textbf{\color{#35bf28}+29.95\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 14.0794ms 11.9814ms 83.4624 Ops/s 83.9063 Ops/s $\color{#d91a1a}-0.53\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.4918ms 1.0425ms 959.2401 Ops/s 960.1312 Ops/s $\color{#d91a1a}-0.09\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 85.8220ms 7.2424ms 138.0761 Ops/s 179.2067 Ops/s $\textbf{\color{#d91a1a}-22.95\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 14.5428ms 12.3523ms 80.9565 Ops/s 72.1692 Ops/s $\textbf{\color{#35bf28}+12.18\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.0565ms 1.3572ms 736.8206 Ops/s 728.0011 Ops/s $\color{#35bf28}+1.21\%$

@github-actions GitHub Actions
Copy link

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1012s 0.1009s 9.9099 Ops/s 9.2138 Ops/s $\textbf{\color{#35bf28}+7.55\%}$
test_sync 91.4691ms 89.1076ms 11.2224 Ops/s 11.3274 Ops/s $\color{#d91a1a}-0.93\%$
test_async 0.1756s 87.5507ms 11.4220 Ops/s 11.2979 Ops/s $\color{#35bf28}+1.10\%$
test_single_pixels 0.1113s 0.1109s 9.0199 Ops/s 8.8646 Ops/s $\color{#35bf28}+1.75\%$
test_sync_pixels 68.9759ms 66.8994ms 14.9478 Ops/s 14.6762 Ops/s $\color{#35bf28}+1.85\%$
test_async_pixels 0.1241s 63.6019ms 15.7228 Ops/s 17.7370 Ops/s $\textbf{\color{#d91a1a}-11.36\%}$
test_simple 0.6735s 0.6638s 1.5065 Ops/s 1.4501 Ops/s $\color{#35bf28}+3.89\%$
test_transformed 0.8746s 0.8690s 1.1507 Ops/s 1.1234 Ops/s $\color{#35bf28}+2.43\%$
test_serial 2.1341s 2.0780s 0.4812 Ops/s 0.4663 Ops/s $\color{#35bf28}+3.20\%$
test_parallel 1.8624s 1.8119s 0.5519 Ops/s 0.5516 Ops/s $\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-True-True-True-True] 87.9540μs 32.9484μs 30.3505 KOps/s 31.0158 KOps/s $\color{#d91a1a}-2.15\%$
test_step_mdp_speed[True-True-True-True-False] 45.5920μs 19.2652μs 51.9070 KOps/s 51.7698 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-True-True-False-True] 42.6920μs 18.3851μs 54.3919 KOps/s 55.1222 KOps/s $\color{#d91a1a}-1.32\%$
test_step_mdp_speed[True-True-True-False-False] 35.1020μs 10.9459μs 91.3582 KOps/s 91.3320 KOps/s $\color{#35bf28}+0.03\%$
test_step_mdp_speed[True-True-False-True-True] 62.2830μs 34.6906μs 28.8262 KOps/s 29.6005 KOps/s $\color{#d91a1a}-2.62\%$
test_step_mdp_speed[True-True-False-True-False] 39.9410μs 20.8999μs 47.8470 KOps/s 46.9523 KOps/s $\color{#35bf28}+1.91\%$
test_step_mdp_speed[True-True-False-False-True] 56.1230μs 20.1097μs 49.7271 KOps/s 49.4366 KOps/s $\color{#35bf28}+0.59\%$
test_step_mdp_speed[True-True-False-False-False] 31.0820μs 12.8292μs 77.9473 KOps/s 76.8195 KOps/s $\color{#35bf28}+1.47\%$
test_step_mdp_speed[True-False-True-True-True] 66.8830μs 35.9823μs 27.7915 KOps/s 27.1879 KOps/s $\color{#35bf28}+2.22\%$
test_step_mdp_speed[True-False-True-True-False] 54.1830μs 22.7603μs 43.9362 KOps/s 42.5715 KOps/s $\color{#35bf28}+3.21\%$
test_step_mdp_speed[True-False-True-False-True] 55.2820μs 19.9520μs 50.1202 KOps/s 49.5770 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[True-False-True-False-False] 30.9420μs 12.7745μs 78.2809 KOps/s 77.7157 KOps/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-False-False-True-True] 56.4720μs 37.0774μs 26.9706 KOps/s 26.4433 KOps/s $\color{#35bf28}+1.99\%$
test_step_mdp_speed[True-False-False-True-False] 43.7620μs 24.1948μs 41.3311 KOps/s 39.9046 KOps/s $\color{#35bf28}+3.57\%$
test_step_mdp_speed[True-False-False-False-True] 41.6420μs 21.4888μs 46.5358 KOps/s 45.5966 KOps/s $\color{#35bf28}+2.06\%$
test_step_mdp_speed[True-False-False-False-False] 47.3620μs 14.4388μs 69.2579 KOps/s 67.5291 KOps/s $\color{#35bf28}+2.56\%$
test_step_mdp_speed[False-True-True-True-True] 58.6320μs 35.5675μs 28.1155 KOps/s 27.2872 KOps/s $\color{#35bf28}+3.04\%$
test_step_mdp_speed[False-True-True-True-False] 45.4720μs 22.5640μs 44.3183 KOps/s 43.0926 KOps/s $\color{#35bf28}+2.84\%$
test_step_mdp_speed[False-True-True-False-True] 42.4720μs 23.6731μs 42.2420 KOps/s 41.4781 KOps/s $\color{#35bf28}+1.84\%$
test_step_mdp_speed[False-True-True-False-False] 32.5510μs 14.4012μs 69.4384 KOps/s 67.3858 KOps/s $\color{#35bf28}+3.05\%$
test_step_mdp_speed[False-True-False-True-True] 67.9130μs 37.8800μs 26.3992 KOps/s 25.9951 KOps/s $\color{#35bf28}+1.55\%$
test_step_mdp_speed[False-True-False-True-False] 53.3520μs 24.7113μs 40.4673 KOps/s 39.5649 KOps/s $\color{#35bf28}+2.28\%$
test_step_mdp_speed[False-True-False-False-True] 62.7820μs 25.5261μs 39.1755 KOps/s 38.7498 KOps/s $\color{#35bf28}+1.10\%$
test_step_mdp_speed[False-True-False-False-False] 35.8010μs 16.1214μs 62.0295 KOps/s 59.5424 KOps/s $\color{#35bf28}+4.18\%$
test_step_mdp_speed[False-False-True-True-True] 62.0330μs 39.1537μs 25.5404 KOps/s 24.9841 KOps/s $\color{#35bf28}+2.23\%$
test_step_mdp_speed[False-False-True-True-False] 55.7330μs 26.1020μs 38.3113 KOps/s 36.7259 KOps/s $\color{#35bf28}+4.32\%$
test_step_mdp_speed[False-False-True-False-True] 52.1920μs 25.3336μs 39.4732 KOps/s 39.3613 KOps/s $\color{#35bf28}+0.28\%$
test_step_mdp_speed[False-False-True-False-False] 34.6320μs 16.0687μs 62.2329 KOps/s 60.1417 KOps/s $\color{#35bf28}+3.48\%$
test_step_mdp_speed[False-False-False-True-True] 78.0430μs 40.0598μs 24.9627 KOps/s 23.9904 KOps/s $\color{#35bf28}+4.05\%$
test_step_mdp_speed[False-False-False-True-False] 51.6420μs 27.8862μs 35.8601 KOps/s 34.0371 KOps/s $\textbf{\color{#35bf28}+5.36\%}$
test_step_mdp_speed[False-False-False-False-True] 60.1430μs 26.7447μs 37.3906 KOps/s 36.6674 KOps/s $\color{#35bf28}+1.97\%$
test_step_mdp_speed[False-False-False-False-False] 38.0610μs 17.8931μs 55.8874 KOps/s 53.8604 KOps/s $\color{#35bf28}+3.76\%$
test_values[generalized_advantage_estimate-True-True] 25.0058ms 24.7101ms 40.4692 Ops/s 39.6213 Ops/s $\color{#35bf28}+2.14\%$
test_values[vec_generalized_advantage_estimate-True-True] 82.4572ms 3.2081ms 311.7097 Ops/s 310.3259 Ops/s $\color{#35bf28}+0.45\%$
test_values[td0_return_estimate-False-False] 93.3940μs 63.9633μs 15.6340 KOps/s 15.4822 KOps/s $\color{#35bf28}+0.98\%$
test_values[td1_return_estimate-False-False] 53.5075ms 52.8251ms 18.9304 Ops/s 18.9085 Ops/s $\color{#35bf28}+0.12\%$
test_values[vec_td1_return_estimate-False-False] 2.1381ms 1.7631ms 567.1700 Ops/s 565.5485 Ops/s $\color{#35bf28}+0.29\%$
test_values[td_lambda_return_estimate-True-False] 84.8528ms 84.0894ms 11.8921 Ops/s 11.8444 Ops/s $\color{#35bf28}+0.40\%$
test_values[vec_td_lambda_return_estimate-True-False] 2.1099ms 1.7571ms 569.1316 Ops/s 567.6448 Ops/s $\color{#35bf28}+0.26\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 24.0273ms 23.3788ms 42.7738 Ops/s 43.1427 Ops/s $\color{#d91a1a}-0.86\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 0.8947ms 0.6946ms 1.4396 KOps/s 1.4243 KOps/s $\color{#35bf28}+1.07\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7159ms 0.6435ms 1.5539 KOps/s 1.5341 KOps/s $\color{#35bf28}+1.29\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5133ms 1.4473ms 690.9555 Ops/s 688.3611 Ops/s $\color{#35bf28}+0.38\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.9456ms 0.6661ms 1.5013 KOps/s 1.4840 KOps/s $\color{#35bf28}+1.17\%$
test_dqn_speed 8.7704ms 1.4278ms 700.3997 Ops/s 670.6640 Ops/s $\color{#35bf28}+4.43\%$
test_ddpg_speed 3.1917ms 2.6885ms 371.9482 Ops/s 366.7211 Ops/s $\color{#35bf28}+1.43\%$
test_sac_speed 8.6238ms 8.0435ms 124.3238 Ops/s 124.4298 Ops/s $\color{#d91a1a}-0.09\%$
test_redq_speed 11.6156ms 10.2698ms 97.3727 Ops/s 97.6790 Ops/s $\color{#d91a1a}-0.31\%$
test_redq_deprec_speed 11.7088ms 10.8190ms 92.4304 Ops/s 91.4338 Ops/s $\color{#35bf28}+1.09\%$
test_td3_speed 8.0754ms 7.9243ms 126.1947 Ops/s 124.6049 Ops/s $\color{#35bf28}+1.28\%$
test_cql_speed 26.1112ms 25.1103ms 39.8243 Ops/s 39.7569 Ops/s $\color{#35bf28}+0.17\%$
test_a2c_speed 5.6457ms 5.4806ms 182.4613 Ops/s 183.5900 Ops/s $\color{#d91a1a}-0.61\%$
test_ppo_speed 5.9871ms 5.7942ms 172.5855 Ops/s 171.8455 Ops/s $\color{#35bf28}+0.43\%$
test_reinforce_speed 4.7242ms 4.4704ms 223.6919 Ops/s 222.2220 Ops/s $\color{#35bf28}+0.66\%$
test_iql_speed 20.4906ms 19.4658ms 51.3721 Ops/s 51.6621 Ops/s $\color{#d91a1a}-0.56\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0761ms 2.8660ms 348.9161 Ops/s 342.2744 Ops/s $\color{#35bf28}+1.94\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.0971ms 0.5370ms 1.8621 KOps/s 1.8316 KOps/s $\color{#35bf28}+1.67\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6996ms 0.5161ms 1.9378 KOps/s 1.9157 KOps/s $\color{#35bf28}+1.15\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.1391ms 2.8401ms 352.1035 Ops/s 339.8522 Ops/s $\color{#35bf28}+3.60\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.2372ms 0.5271ms 1.8972 KOps/s 1.8719 KOps/s $\color{#35bf28}+1.35\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7263ms 0.5081ms 1.9682 KOps/s 1.9240 KOps/s $\color{#35bf28}+2.29\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 0.1171s 1.7519ms 570.7941 Ops/s 654.6545 Ops/s $\textbf{\color{#d91a1a}-12.81\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5612ms 1.4212ms 703.6542 Ops/s 685.7876 Ops/s $\color{#35bf28}+2.61\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1872ms 2.9766ms 335.9507 Ops/s 326.9156 Ops/s $\color{#35bf28}+2.76\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7906ms 0.6619ms 1.5108 KOps/s 1.2860 KOps/s $\textbf{\color{#35bf28}+17.48\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.4077ms 0.6448ms 1.5509 KOps/s 1.5413 KOps/s $\color{#35bf28}+0.62\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 3.0067ms 2.8526ms 350.5570 Ops/s 342.7103 Ops/s $\color{#35bf28}+2.29\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6508ms 0.5367ms 1.8632 KOps/s 1.8375 KOps/s $\color{#35bf28}+1.40\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7158ms 0.5190ms 1.9266 KOps/s 1.9263 KOps/s $\color{#35bf28}+0.02\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 3.0653ms 2.8793ms 347.3049 Ops/s 341.3686 Ops/s $\color{#35bf28}+1.74\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.3107ms 0.5326ms 1.8777 KOps/s 1.8574 KOps/s $\color{#35bf28}+1.09\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.7906ms 0.5126ms 1.9508 KOps/s 1.9181 KOps/s $\color{#35bf28}+1.71\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 3.1515ms 2.9873ms 334.7457 Ops/s 327.5978 Ops/s $\color{#35bf28}+2.18\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8474ms 0.6752ms 1.4811 KOps/s 1.4813 KOps/s $\color{#d91a1a}-0.01\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 4.4708ms 0.6459ms 1.5481 KOps/s 1.5377 KOps/s $\color{#35bf28}+0.68\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1172s 7.0125ms 142.6022 Ops/s 109.5148 Ops/s $\textbf{\color{#35bf28}+30.21\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.7132ms 14.2709ms 70.0729 Ops/s 67.7201 Ops/s $\color{#35bf28}+3.47\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1042ms 1.0604ms 943.0021 Ops/s 850.6732 Ops/s $\textbf{\color{#35bf28}+10.85\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1023s 8.7140ms 114.7582 Ops/s 148.2461 Ops/s $\textbf{\color{#d91a1a}-22.59\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 16.6287ms 14.2750ms 70.0527 Ops/s 67.8195 Ops/s $\color{#35bf28}+3.29\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.1031ms 1.0472ms 954.9618 Ops/s 781.3069 Ops/s $\textbf{\color{#35bf28}+22.23\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1031s 7.0988ms 140.8696 Ops/s 110.4590 Ops/s $\textbf{\color{#35bf28}+27.53\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 16.9708ms 14.5407ms 68.7725 Ops/s 65.8579 Ops/s $\color{#35bf28}+4.43\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 1.5095ms 1.4051ms 711.6999 Ops/s 674.6450 Ops/s $\textbf{\color{#35bf28}+5.49\%}$

@vmoens vmoens added the documentation Improvements or additions to documentation label Mar 20, 2024
@vmoens vmoens merged commit d0e4c04 into main Oct 11, 2024
23 of 43 checks passed
@vmoens vmoens deleted the rewrite-readme branch October 11, 2024 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. documentation Improvements or additions to documentation
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot