[CI] Fix SOTA runs

[vmoens]

Stack from ghstack (oldest at bottom):

• -> [CI] Fix SOTA runs #3252
• [Setup] Python 3.14 in, python 3.9 out #3251

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3252

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• Can't find 'action.yml', 'action.yaml' or 'Dockerfile' under '/home/ec2-user/actions-runner/_work/pytorch/pytorch/.github/actions/check-tpu'

❌ 10 New Failures, 1 Cancelled Job, 3 Unrelated Failures

As of commit 844f22f with merge base 3cd740a ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  Process completed with exit code 139.
• Generate documentation / build-docs (3.12, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t 7910451b6d20ae29f6a5b5eef754b1212b0e8008797daaf13615ba6c7db5550d /exec failed with exit code 2
• Habitat Tests on Linux / tests (3.9, 12.8) / linux-job (gh)
  RuntimeError: Command docker exec -t f4e66d9a17200eee3639a8066c7d1d4193f03865ee712a5e023eb6e1031334e8 /exec failed with exit code 1
• SOTA Tests on Linux / tests (3.10, 13.0) / linux-job (gh)
  /tmp/torchinductor_root/r4/cr4njlyrmlve2js77cruroaoxp4u5x33mbeenkkchxovuktlcdd4.main.cpp:182:62: error: cannot convert ‘long int’ to ‘const at::vec::CPU_CAPABILITY::VectorizedN<long int, 2>&’
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  test/test_env.py::TestNonTensorEnv::test_parallel[False-False]
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  RuntimeError: Command docker exec -t 146b83a7f7e75bb91102ee5a82a4209c8b75cfaf501c51b3e82665a60ccadc61 /exec failed with exit code 1
• Unit-tests on Linux / tests-cpu (3.13) / linux-job (gh)
  RuntimeError: Command docker exec -t 989a9903d66c7eba07519105ca42f2c1bc2561de55272a4e4971d4d19da83ffe /exec failed with exit code 127
• Unit-tests on Linux / tests-cpu (3.14) / linux-job (gh)
  RuntimeError: Command docker exec -t 14c1dd6a903d97a176db65361b6411ce0ac0260369755d1c169852536aad09b0 /exec failed with exit code 1
• Unit-tests on Linux / tests-gpu (3.12, 13.0) / linux-job (gh)
  RuntimeError: Command docker exec -t 164c8484a630fd677f6431061e440b21237efcd9008160fa98213a01a4569400 /exec failed with exit code 1
• Unit-tests on Linux / tests-stable-gpu (3.12, 13.0) / linux-job (gh)
  RuntimeError: Command docker exec -t cdf8a8f41ba0a30b71acc53ec3035aec1cb0f1ccdff601946057a774968f1ff8 /exec failed with exit code 1

CANCELLED JOB - The following job was cancelled. Please retry:

• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  ##[error]The operation was canceled.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Libs Tests on Linux / unittests-gym (3.9, 12.8) / linux-job (gh) (trunk failure)
  RuntimeError: SumSegmentTreeFp32 is not available. See warning above.
• Unit-tests on Linux / tests-olddeps (3.9, 11.6) / linux-job (gh) (trunk failure)
  test/test_collector.py::TestAsyncCollection::test_start_update_policy[SharedMemWeightSyncScheme-MultiSyncDataCollector-1000000000]
• Unit-tests on Windows / unittests-cpu (3.10, windows.4xlarge, cpu) / windows-job (gh) (trunk failure)
  test/test_transforms.py::TestRayModuleTransform::test_ray_module_transform_scheme_collector

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 154. Improved: $\large\color{#35bf28}16$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_tensor_to_bytestream_speed[pickle]	81.6968μs	80.8091μs	12.3749 KOps/s	11.8538 KOps/s	$\color{#35bf28}+4.40\%$
test_tensor_to_bytestream_speed[torch.save]	0.1445ms	0.1408ms	7.1027 KOps/s	6.9751 KOps/s	$\color{#35bf28}+1.83\%$
test_tensor_to_bytestream_speed[untyped_storage]	0.1238s	0.1235s	8.0982 Ops/s	8.1351 Ops/s	$\color{#d91a1a}-0.45\%$
test_tensor_to_bytestream_speed[numpy]	2.8074μs	2.8035μs	356.6969 KOps/s	359.6887 KOps/s	$\color{#d91a1a}-0.83\%$
test_tensor_to_bytestream_speed[safetensors]	40.7558μs	39.5185μs	25.3046 KOps/s	25.7634 KOps/s	$\color{#d91a1a}-1.78\%$
test_simple	0.5671s	0.5571s	1.7949 Ops/s	1.7260 Ops/s	$\color{#35bf28}+3.99\%$
test_transformed	1.2586s	1.1638s	0.8593 Ops/s	0.8566 Ops/s	$\color{#35bf28}+0.31\%$
test_serial	1.6977s	1.6929s	0.5907 Ops/s	0.5849 Ops/s	$\color{#35bf28}+1.00\%$
test_parallel	1.1810s	1.1369s	0.8796 Ops/s	0.9134 Ops/s	$\color{#d91a1a}-3.71\%$
test_step_mdp_speed[True-True-True-True-True]	0.2833ms	44.6843μs	22.3792 KOps/s	22.4748 KOps/s	$\color{#d91a1a}-0.43\%$
test_step_mdp_speed[True-True-True-True-False]	55.7510μs	24.9364μs	40.1021 KOps/s	39.6742 KOps/s	$\color{#35bf28}+1.08\%$
test_step_mdp_speed[True-True-True-False-True]	56.2710μs	24.9659μs	40.0546 KOps/s	39.1539 KOps/s	$\color{#35bf28}+2.30\%$
test_step_mdp_speed[True-True-True-False-False]	43.3510μs	13.9898μs	71.4806 KOps/s	70.9515 KOps/s	$\color{#35bf28}+0.75\%$
test_step_mdp_speed[True-True-False-True-True]	81.6210μs	48.3200μs	20.6954 KOps/s	20.4397 KOps/s	$\color{#35bf28}+1.25\%$
test_step_mdp_speed[True-True-False-True-False]	52.8110μs	27.7281μs	36.0644 KOps/s	35.1376 KOps/s	$\color{#35bf28}+2.64\%$
test_step_mdp_speed[True-True-False-False-True]	64.3910μs	28.1116μs	35.5726 KOps/s	34.6126 KOps/s	$\color{#35bf28}+2.77\%$
test_step_mdp_speed[True-True-False-False-False]	42.2310μs	16.6613μs	60.0194 KOps/s	59.1515 KOps/s	$\color{#35bf28}+1.47\%$
test_step_mdp_speed[True-False-True-True-True]	93.4320μs	51.1075μs	19.5666 KOps/s	19.0634 KOps/s	$\color{#35bf28}+2.64\%$
test_step_mdp_speed[True-False-True-True-False]	58.9120μs	30.6975μs	32.5760 KOps/s	31.9871 KOps/s	$\color{#35bf28}+1.84\%$
test_step_mdp_speed[True-False-True-False-True]	61.8910μs	27.6401μs	36.1794 KOps/s	34.8970 KOps/s	$\color{#35bf28}+3.67\%$
test_step_mdp_speed[True-False-True-False-False]	52.6010μs	16.7478μs	59.7093 KOps/s	58.7960 KOps/s	$\color{#35bf28}+1.55\%$
test_step_mdp_speed[True-False-False-True-True]	86.4320μs	53.5650μs	18.6689 KOps/s	18.2778 KOps/s	$\color{#35bf28}+2.14\%$
test_step_mdp_speed[True-False-False-True-False]	66.2310μs	33.6592μs	29.7096 KOps/s	29.7390 KOps/s	$\color{#d91a1a}-0.10\%$
test_step_mdp_speed[True-False-False-False-True]	59.6310μs	30.5697μs	32.7121 KOps/s	32.2905 KOps/s	$\color{#35bf28}+1.31\%$
test_step_mdp_speed[True-False-False-False-False]	46.0510μs	19.5251μs	51.2160 KOps/s	51.1402 KOps/s	$\color{#35bf28}+0.15\%$
test_step_mdp_speed[False-True-True-True-True]	78.5420μs	50.9904μs	19.6115 KOps/s	19.0639 KOps/s	$\color{#35bf28}+2.87\%$
test_step_mdp_speed[False-True-True-True-False]	59.0220μs	30.5667μs	32.7153 KOps/s	32.1089 KOps/s	$\color{#35bf28}+1.89\%$
test_step_mdp_speed[False-True-True-False-True]	2.4079ms	31.8570μs	31.3902 KOps/s	30.2533 KOps/s	$\color{#35bf28}+3.76\%$
test_step_mdp_speed[False-True-True-False-False]	45.6010μs	18.4044μs	54.3348 KOps/s	53.2150 KOps/s	$\color{#35bf28}+2.10\%$
test_step_mdp_speed[False-True-False-True-True]	83.5320μs	52.3445μs	19.1042 KOps/s	18.3099 KOps/s	$\color{#35bf28}+4.34\%$
test_step_mdp_speed[False-True-False-True-False]	69.5320μs	33.2190μs	30.1033 KOps/s	29.9631 KOps/s	$\color{#35bf28}+0.47\%$
test_step_mdp_speed[False-True-False-False-True]	72.1620μs	34.2849μs	29.1674 KOps/s	28.2110 KOps/s	$\color{#35bf28}+3.39\%$
test_step_mdp_speed[False-True-False-False-False]	49.9320μs	20.9467μs	47.7403 KOps/s	47.1179 KOps/s	$\color{#35bf28}+1.32\%$
test_step_mdp_speed[False-False-True-True-True]	0.1002ms	56.2838μs	17.7671 KOps/s	17.3274 KOps/s	$\color{#35bf28}+2.54\%$
test_step_mdp_speed[False-False-True-True-False]	66.3810μs	35.8816μs	27.8694 KOps/s	27.1409 KOps/s	$\color{#35bf28}+2.68\%$
test_step_mdp_speed[False-False-True-False-True]	69.6220μs	33.9735μs	29.4347 KOps/s	28.2433 KOps/s	$\color{#35bf28}+4.22\%$
test_step_mdp_speed[False-False-True-False-False]	52.6820μs	21.1156μs	47.3583 KOps/s	46.7136 KOps/s	$\color{#35bf28}+1.38\%$
test_step_mdp_speed[False-False-False-True-True]	90.8320μs	57.1695μs	17.4918 KOps/s	16.9125 KOps/s	$\color{#35bf28}+3.43\%$
test_step_mdp_speed[False-False-False-True-False]	83.3120μs	38.8320μs	25.7519 KOps/s	25.5300 KOps/s	$\color{#35bf28}+0.87\%$
test_step_mdp_speed[False-False-False-False-True]	68.7320μs	37.1282μs	26.9337 KOps/s	27.1358 KOps/s	$\color{#d91a1a}-0.74\%$
test_step_mdp_speed[False-False-False-False-False]	50.0510μs	24.0617μs	41.5598 KOps/s	41.4704 KOps/s	$\color{#35bf28}+0.22\%$
test_values[generalized_advantage_estimate-True-True]	11.1067ms	10.8378ms	92.2693 Ops/s	95.0404 Ops/s	$\color{#d91a1a}-2.92\%$
test_values[vec_generalized_advantage_estimate-True-True]	19.3495ms	17.7555ms	56.3207 Ops/s	56.6700 Ops/s	$\color{#d91a1a}-0.62\%$
test_values[td0_return_estimate-False-False]	0.2250ms	0.1325ms	7.5453 KOps/s	7.7827 KOps/s	$\color{#d91a1a}-3.05\%$
test_values[td1_return_estimate-False-False]	29.5715ms	29.2135ms	34.2308 Ops/s	34.3529 Ops/s	$\color{#d91a1a}-0.36\%$
test_values[vec_td1_return_estimate-False-False]	18.2633ms	17.7661ms	56.2870 Ops/s	56.7476 Ops/s	$\color{#d91a1a}-0.81\%$
test_values[td_lambda_return_estimate-True-False]	44.5681ms	43.7857ms	22.8385 Ops/s	23.1828 Ops/s	$\color{#d91a1a}-1.49\%$
test_values[vec_td_lambda_return_estimate-True-False]	18.3621ms	17.7801ms	56.2427 Ops/s	56.9034 Ops/s	$\color{#d91a1a}-1.16\%$
test_gae_speed[generalized_advantage_estimate-False-1-512]	10.2840ms	9.5976ms	104.1926 Ops/s	107.5297 Ops/s	$\color{#d91a1a}-3.10\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.8199ms	1.5378ms	650.2605 Ops/s	640.9596 Ops/s	$\color{#35bf28}+1.45\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.5158ms	0.4286ms	2.3330 KOps/s	2.3583 KOps/s	$\color{#d91a1a}-1.07\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	34.7584ms	33.1679ms	30.1496 Ops/s	33.5884 Ops/s	$\textbf{\color{#d91a1a}-10.24\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	1.9336ms	1.7567ms	569.2533 Ops/s	567.6820 Ops/s	$\color{#35bf28}+0.28\%$
test_dqn_speed[False-None]	6.4235ms	1.4373ms	695.7692 Ops/s	696.0579 Ops/s	$\color{#d91a1a}-0.04\%$
test_dqn_speed[False-backward]	1.9870ms	1.9315ms	517.7234 Ops/s	513.7956 Ops/s	$\color{#35bf28}+0.76\%$
test_dqn_speed[True-None]	0.7230ms	0.5393ms	1.8543 KOps/s	1.7974 KOps/s	$\color{#35bf28}+3.17\%$
test_dqn_speed[True-backward]	1.0226ms	0.9730ms	1.0277 KOps/s	915.8143 Ops/s	$\textbf{\color{#35bf28}+12.22\%}$
test_dqn_speed[reduce-overhead-None]	0.6469ms	0.5151ms	1.9413 KOps/s	1.9012 KOps/s	$\color{#35bf28}+2.11\%$
test_dqn_speed[reduce-overhead-backward]	1.0580ms	0.9633ms	1.0381 KOps/s	926.6635 Ops/s	$\textbf{\color{#35bf28}+12.03\%}$
test_ddpg_speed[False-None]	3.5804ms	2.9037ms	344.3835 Ops/s	341.5533 Ops/s	$\color{#35bf28}+0.83\%$
test_ddpg_speed[False-backward]	4.2149ms	4.1108ms	243.2639 Ops/s	244.4049 Ops/s	$\color{#d91a1a}-0.47\%$
test_ddpg_speed[True-None]	1.6112ms	1.3984ms	715.1012 Ops/s	729.5774 Ops/s	$\color{#d91a1a}-1.98\%$
test_ddpg_speed[True-backward]	2.4879ms	2.3886ms	418.6555 Ops/s	369.4814 Ops/s	$\textbf{\color{#35bf28}+13.31\%}$
test_ddpg_speed[reduce-overhead-None]	1.7699ms	1.3967ms	715.9516 Ops/s	720.9150 Ops/s	$\color{#d91a1a}-0.69\%$
test_ddpg_speed[reduce-overhead-backward]	2.4647ms	2.3980ms	417.0127 Ops/s	407.9867 Ops/s	$\color{#35bf28}+2.21\%$
test_sac_speed[False-None]	9.3530ms	8.1026ms	123.4173 Ops/s	123.5850 Ops/s	$\color{#d91a1a}-0.14\%$
test_sac_speed[False-backward]	11.5151ms	11.3697ms	87.9533 Ops/s	87.3654 Ops/s	$\color{#35bf28}+0.67\%$
test_sac_speed[True-None]	2.5926ms	2.1617ms	462.6013 Ops/s	466.4830 Ops/s	$\color{#d91a1a}-0.83\%$
test_sac_speed[True-backward]	4.3065ms	4.1324ms	241.9875 Ops/s	215.8885 Ops/s	$\textbf{\color{#35bf28}+12.09\%}$
test_sac_speed[reduce-overhead-None]	2.4411ms	2.1611ms	462.7336 Ops/s	471.4852 Ops/s	$\color{#d91a1a}-1.86\%$
test_sac_speed[reduce-overhead-backward]	4.2831ms	4.1172ms	242.8823 Ops/s	218.5618 Ops/s	$\textbf{\color{#35bf28}+11.13\%}$
test_redq_speed[False-None]	15.3796ms	10.8494ms	92.1707 Ops/s	92.1588 Ops/s	$\color{#35bf28}+0.01\%$
test_redq_speed[False-backward]	24.0388ms	18.9601ms	52.7423 Ops/s	53.6147 Ops/s	$\color{#d91a1a}-1.63\%$
test_redq_speed[True-None]	4.8744ms	4.4330ms	225.5793 Ops/s	227.9052 Ops/s	$\color{#d91a1a}-1.02\%$
test_redq_speed[True-backward]	10.5998ms	10.0180ms	99.8207 Ops/s	100.4165 Ops/s	$\color{#d91a1a}-0.59\%$
test_redq_speed[reduce-overhead-None]	4.9151ms	4.4572ms	224.3556 Ops/s	227.5854 Ops/s	$\color{#d91a1a}-1.42\%$
test_redq_speed[reduce-overhead-backward]	10.6737ms	10.0358ms	99.6429 Ops/s	101.8692 Ops/s	$\color{#d91a1a}-2.19\%$
test_redq_deprec_speed[False-None]	13.7451ms	11.1823ms	89.4267 Ops/s	90.2388 Ops/s	$\color{#d91a1a}-0.90\%$
test_redq_deprec_speed[False-backward]	16.5798ms	16.0920ms	62.1428 Ops/s	63.0968 Ops/s	$\color{#d91a1a}-1.51\%$
test_redq_deprec_speed[True-None]	4.0626ms	3.7193ms	268.8675 Ops/s	262.2526 Ops/s	$\color{#35bf28}+2.52\%$
test_redq_deprec_speed[True-backward]	8.0809ms	7.7031ms	129.8180 Ops/s	119.9582 Ops/s	$\textbf{\color{#35bf28}+8.22\%}$
test_redq_deprec_speed[reduce-overhead-None]	4.0421ms	3.6168ms	276.4900 Ops/s	274.7218 Ops/s	$\color{#35bf28}+0.64\%$
test_redq_deprec_speed[reduce-overhead-backward]	7.9407ms	7.6105ms	131.3973 Ops/s	125.6137 Ops/s	$\color{#35bf28}+4.60\%$
test_td3_speed[False-None]	8.2797ms	8.0810ms	123.7468 Ops/s	123.6277 Ops/s	$\color{#35bf28}+0.10\%$
test_td3_speed[False-backward]	11.5756ms	10.9632ms	91.2143 Ops/s	91.6901 Ops/s	$\color{#d91a1a}-0.52\%$
test_td3_speed[True-None]	1.8902ms	1.8384ms	543.9651 Ops/s	543.2711 Ops/s	$\color{#35bf28}+0.13\%$
test_td3_speed[True-backward]	3.7860ms	3.6529ms	273.7545 Ops/s	273.3066 Ops/s	$\color{#35bf28}+0.16\%$
test_td3_speed[reduce-overhead-None]	1.8812ms	1.8268ms	547.3926 Ops/s	554.8789 Ops/s	$\color{#d91a1a}-1.35\%$
test_td3_speed[reduce-overhead-backward]	3.8216ms	3.6897ms	271.0215 Ops/s	263.3963 Ops/s	$\color{#35bf28}+2.89\%$
test_cql_speed[False-None]	29.2124ms	26.5878ms	37.6113 Ops/s	37.8154 Ops/s	$\color{#d91a1a}-0.54\%$
test_cql_speed[False-backward]	36.4806ms	35.7604ms	27.9639 Ops/s	27.6075 Ops/s	$\color{#35bf28}+1.29\%$
test_cql_speed[True-None]	12.9894ms	12.5703ms	79.5529 Ops/s	80.2571 Ops/s	$\color{#d91a1a}-0.88\%$
test_cql_speed[True-backward]	18.8407ms	18.4228ms	54.2807 Ops/s	57.6062 Ops/s	$\textbf{\color{#d91a1a}-5.77\%}$
test_cql_speed[reduce-overhead-None]	12.7502ms	12.3874ms	80.7269 Ops/s	82.4731 Ops/s	$\color{#d91a1a}-2.12\%$
test_cql_speed[reduce-overhead-backward]	19.0781ms	18.6142ms	53.7225 Ops/s	57.4459 Ops/s	$\textbf{\color{#d91a1a}-6.48\%}$
test_a2c_speed[False-None]	5.8521ms	5.4393ms	183.8471 Ops/s	179.8650 Ops/s	$\color{#35bf28}+2.21\%$
test_a2c_speed[False-backward]	12.4236ms	11.9724ms	83.5258 Ops/s	84.8453 Ops/s	$\color{#d91a1a}-1.56\%$
test_a2c_speed[True-None]	3.9144ms	3.7391ms	267.4449 Ops/s	263.3631 Ops/s	$\color{#35bf28}+1.55\%$
test_a2c_speed[True-backward]	8.9896ms	8.7188ms	114.6950 Ops/s	109.5553 Ops/s	$\color{#35bf28}+4.69\%$
test_a2c_speed[reduce-overhead-None]	4.0988ms	3.7082ms	269.6735 Ops/s	270.8286 Ops/s	$\color{#d91a1a}-0.43\%$
test_a2c_speed[reduce-overhead-backward]	8.9494ms	8.8019ms	113.6124 Ops/s	113.1275 Ops/s	$\color{#35bf28}+0.43\%$
test_ppo_speed[False-None]	6.2350ms	5.9752ms	167.3575 Ops/s	165.3295 Ops/s	$\color{#35bf28}+1.23\%$
test_ppo_speed[False-backward]	13.0990ms	12.6998ms	78.7414 Ops/s	77.8013 Ops/s	$\color{#35bf28}+1.21\%$
test_ppo_speed[True-None]	3.7972ms	3.6312ms	275.3903 Ops/s	273.6945 Ops/s	$\color{#35bf28}+0.62\%$
test_ppo_speed[True-backward]	9.0507ms	8.6294ms	115.8833 Ops/s	118.1329 Ops/s	$\color{#d91a1a}-1.90\%$
test_ppo_speed[reduce-overhead-None]	4.0815ms	3.6038ms	277.4857 Ops/s	273.6053 Ops/s	$\color{#35bf28}+1.42\%$
test_ppo_speed[reduce-overhead-backward]	8.9687ms	8.7301ms	114.5468 Ops/s	115.6408 Ops/s	$\color{#d91a1a}-0.95\%$
test_reinforce_speed[False-None]	6.9368ms	4.5262ms	220.9341 Ops/s	218.0855 Ops/s	$\color{#35bf28}+1.31\%$
test_reinforce_speed[False-backward]	7.7169ms	7.3310ms	136.4075 Ops/s	134.6187 Ops/s	$\color{#35bf28}+1.33\%$
test_reinforce_speed[True-None]	3.3344ms	2.8853ms	346.5808 Ops/s	345.8885 Ops/s	$\color{#35bf28}+0.20\%$
test_reinforce_speed[True-backward]	8.2707ms	7.8630ms	127.1777 Ops/s	130.4791 Ops/s	$\color{#d91a1a}-2.53\%$
test_reinforce_speed[reduce-overhead-None]	3.5567ms	2.8827ms	346.8981 Ops/s	343.5242 Ops/s	$\color{#35bf28}+0.98\%$
test_reinforce_speed[reduce-overhead-backward]	8.7944ms	8.0415ms	124.3543 Ops/s	126.5859 Ops/s	$\color{#d91a1a}-1.76\%$
test_iql_speed[False-None]	25.5263ms	20.4502ms	48.8992 Ops/s	49.3330 Ops/s	$\color{#d91a1a}-0.88\%$
test_iql_speed[False-backward]	33.0121ms	31.0139ms	32.2436 Ops/s	32.7907 Ops/s	$\color{#d91a1a}-1.67\%$
test_iql_speed[True-None]	8.9007ms	8.5371ms	117.1351 Ops/s	116.6735 Ops/s	$\color{#35bf28}+0.40\%$
test_iql_speed[True-backward]	17.4991ms	16.9759ms	58.9070 Ops/s	58.8158 Ops/s	$\color{#35bf28}+0.16\%$
test_iql_speed[reduce-overhead-None]	9.2685ms	8.7581ms	114.1797 Ops/s	114.9898 Ops/s	$\color{#d91a1a}-0.70\%$
test_iql_speed[reduce-overhead-backward]	17.9706ms	17.5814ms	56.8785 Ops/s	56.7158 Ops/s	$\color{#35bf28}+0.29\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.2132ms	6.0556ms	165.1355 Ops/s	162.1608 Ops/s	$\color{#35bf28}+1.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.9160ms	0.3032ms	3.2983 KOps/s	3.2684 KOps/s	$\color{#35bf28}+0.92\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5129ms	0.2848ms	3.5117 KOps/s	3.6324 KOps/s	$\color{#d91a1a}-3.32\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	5.9052ms	5.7080ms	175.1928 Ops/s	171.5272 Ops/s	$\color{#35bf28}+2.14\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.4820ms	0.2989ms	3.3461 KOps/s	3.4105 KOps/s	$\color{#d91a1a}-1.89\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4944ms	0.2629ms	3.8035 KOps/s	3.6633 KOps/s	$\color{#35bf28}+3.83\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.5265ms	1.3099ms	763.3972 Ops/s	765.9574 Ops/s	$\color{#d91a1a}-0.33\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.4869ms	1.2259ms	815.7521 Ops/s	817.1809 Ops/s	$\color{#d91a1a}-0.17\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.2154ms	5.9406ms	168.3335 Ops/s	166.9463 Ops/s	$\color{#35bf28}+0.83\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.3475ms	0.4801ms	2.0830 KOps/s	1.8703 KOps/s	$\textbf{\color{#35bf28}+11.37\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7416ms	0.4552ms	2.1970 KOps/s	2.0104 KOps/s	$\textbf{\color{#35bf28}+9.28\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.0795ms	5.9266ms	168.7321 Ops/s	170.0835 Ops/s	$\color{#d91a1a}-0.79\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.5852ms	0.3672ms	2.7230 KOps/s	3.0101 KOps/s	$\textbf{\color{#d91a1a}-9.54\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.4869ms	0.2747ms	3.6410 KOps/s	2.9498 KOps/s	$\textbf{\color{#35bf28}+23.43\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.0890ms	5.8596ms	170.6592 Ops/s	172.0173 Ops/s	$\color{#d91a1a}-0.79\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.3493ms	0.3287ms	3.0422 KOps/s	701.6060 Ops/s	$\textbf{\color{#35bf28}+333.61\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.4999ms	0.2931ms	3.4123 KOps/s	2.7238 KOps/s	$\textbf{\color{#35bf28}+25.28\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.1124ms	5.9836ms	167.1244 Ops/s	165.5411 Ops/s	$\color{#35bf28}+0.96\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.9530ms	0.4515ms	2.2150 KOps/s	2.0018 KOps/s	$\textbf{\color{#35bf28}+10.65\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.8342ms	0.4231ms	2.3633 KOps/s	2.0649 KOps/s	$\textbf{\color{#35bf28}+14.45\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	0.5366s	15.7909ms	63.3277 Ops/s	193.9952 Ops/s	$\textbf{\color{#d91a1a}-67.36\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	3.9941ms	1.6751ms	596.9750 Ops/s	485.0070 Ops/s	$\textbf{\color{#35bf28}+23.09\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	7.9307ms	1.2195ms	820.0148 Ops/s	827.5807 Ops/s	$\color{#d91a1a}-0.91\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	6.9149ms	5.1284ms	194.9912 Ops/s	61.8564 Ops/s	$\textbf{\color{#35bf28}+215.23\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	9.9639ms	2.1233ms	470.9585 Ops/s	473.7150 Ops/s	$\color{#d91a1a}-0.58\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	5.9526ms	1.2486ms	800.9228 Ops/s	913.7395 Ops/s	$\textbf{\color{#d91a1a}-12.35\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	6.7985ms	5.2740ms	189.6099 Ops/s	184.5483 Ops/s	$\color{#35bf28}+2.74\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	11.2318ms	2.2779ms	439.0101 Ops/s	450.9648 Ops/s	$\color{#d91a1a}-2.65\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	2.2585ms	1.2762ms	783.5603 Ops/s	695.7605 Ops/s	$\textbf{\color{#35bf28}+12.62\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	35.5728ms	33.4869ms	29.8624 Ops/s	29.5959 Ops/s	$\color{#35bf28}+0.90\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	19.4142ms	17.7937ms	56.1997 Ops/s	56.3335 Ops/s	$\color{#d91a1a}-0.24\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	37.7680ms	34.9857ms	28.5831 Ops/s	28.6986 Ops/s	$\color{#d91a1a}-0.40\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	20.1707ms	18.2426ms	54.8167 Ops/s	54.3993 Ops/s	$\color{#35bf28}+0.77\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	42.0796ms	36.8667ms	27.1247 Ops/s	26.8209 Ops/s	$\color{#35bf28}+1.13\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	24.9805ms	20.1580ms	49.6081 Ops/s	48.6660 Ops/s	$\color{#35bf28}+1.94\%$