[Feature] A2C compatibility with compile

[vmoens]

Stack from ghstack (oldest at bottom):

• [Feature] GAIL compatibility with compile #2573
• [Feature] DQN compatibility with compile #2571
• [Feature] Discrete SAC compatibility with compile #2569
• [Feature] DT compatibility with compile #2556
• [Feature] DDPG compatibility with compile #2555
• [Feature] CROSSQ compatibility with compile #2554
• [Feature] CQL compatibility with compile #2553
• -> [Feature] A2C compatibility with compile #2464

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2464

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• [DomainsOnly] Jobs fail with GLIBC version not found

❌ 19 New Failures, 1 Pending, 6 Unrelated Failures

As of commit 540eaa8 with merge base 1474f85 ():

NEW FAILURES - The following jobs have failed:

• Continuous Benchmark (PR) / CPU Pytest benchmark (gh)
  E TypeError: '<' not supported between instances of 'str' and 'Version'
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh)
  Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit
• Examples Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Generate documentation / build-docs (3.10, 12.1) / linux-job (gh)
• Habitat Tests on Linux / tests (3.9, 12.1) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Libs Tests on Linux / unittests-sklearn (3.9, 12.1) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Lint / c-source / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Lint / python-source-and-configs / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• RLHF Tests on Linux / unittests (3.9, 12.1) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-cpu (3.10) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-cpu (3.11) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-cpu (3.12) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-cpu (3.9) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-cpu-oldget (3.12) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-gpu (3.11, 12.1) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-optdeps (3.11, 12.1) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Linux / tests-stable-gpu (3.10, 11.8) / linux-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge
• Unit-tests on Windows / unittests-cpu / windows-job (gh)
  ##[error]fatal: couldn't find remote ref refs/pull/2464/merge

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Linux Wheels / pytorch/rl (pytorch/rl, test/smoke_test.py, torchrl) / upload / manywheel-py3_9-rocm6_1 (gh) (trunk failure)
  ##[error]Unable to find an artifact with the name: pytorch_rl__3.9_rocm6.1_x86_64
• Build Linux Wheels / pytorch/rl (pytorch/rl, test/smoke_test.py, torchrl) / upload / manywheel-py3_9-rocm6_2 (gh) (trunk failure)
  ##[error]Unable to find an artifact with the name: pytorch_rl__3.9_rocm6.2_x86_64
• Build M1 Wheels / generate-matrix / generate (gh) (trunk failure)
  ValueError: list.remove(x): x not in list
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cpu (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda11_8 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure)
  ##[error]Unable to find any artifacts for the associated workflow

This comment was automatically generated by Dr. CI and updates every 15 minutes.