Speed up rllib test

[Gamenot]

Shorten the time of the test_rllib_hiway_env test.

[saulfield]

What is the speed improvement for this? I think this test took around 30 mins on my machine originally.

[qianyi-sun]

Not sure if this is reasonable, how about we create a even simpler scenario or duplicate an existing scenario just for the test and maybe gitignore it to prevent possible accidentally removal of it? I just have a feeling that in the future somehow we might forget that we have set this scenario for the test and delete it for some reason..

[Gamenot]

Not sure if this is reasonable, how about we create a even simpler scenario or duplicate an existing scenario just for the test and maybe gitignore it to prevent possible accidentally removal of it? I just have a feeling that in the future somehow we might forget that we have set this scenario for the test and delete it for some reason..

I do not think that is possible since it is linked to the CI.

[Gamenot]

What is the speed improvement for this? I think this test took around 30 mins on my machine originally.

I had the test take 3 minutes with this version. The original took 7:26. It might not be enough but it is a definite improvement.

[Gamenot]

@saulfield I think the next step after may be to limit the number of CPUs. We could specifically set the number of CPUs to 1 or 2 and ensure that it is not hogging cores during test or we could use an environment variable in the test to limit the cores to be used in make test.