[CI] Fix 3.12 gymnasium installation

[vmoens]

Stack from ghstack (oldest at bottom):

• -> [CI] Fix 3.12 gymnasium installation #2474

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2474

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 6 Unrelated Failures

As of commit 36b9207 with merge base c8b508e ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  ../../../../../../tmp/test_collectors_benchmark.py::TestRBGCollector::test_multiasync_rb[16-2]
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  /__w/_temp/4296e08e-cba1-41dd-ab61-4bc330a7c298.sh: line 5: 10151 Bus error (core dumped) $RUN_BENCHMARK /tmp/tmp.u46A3sXBRg
• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  RuntimeError: Command docker exec -t 1d12e592c94c7f9d875861e67401d959abd034638c8ab1871b6ac962113736ae /exec failed with exit code 134

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cpu (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda11_8 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_1 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh) (trunk failure)
  test/test_transforms.py::TestKLRewardTransform::test_kl_lstm
• Unit-tests on Windows / unittests-cpu / windows-job (gh) (trunk failure)
  RuntimeError: Compiler: cl is not found.

This comment was automatically generated by Dr. CI and updates every 15 minutes.