[CI] Add persistent cache mounts and fix test download paths#36951

AndreasKaratzas wants to merge 5 commits intovllm-project:mainvllm-project/vllm:mainfrom

ROCm:akaratza_revamp_test_cacheROCm/vllm:akaratza_revamp_test_cacheCopy head branch name to clipboard