GPU/GRAM usage for workers and actors and nodes

[edoakes]

In the existing dashboard we can see both GPU usage and GRAM usage for workers.

[hegdeashwin]

@edoakes My Ray dev setup is on Apple Macbook Pro M1 (2020), which has 8 Core GPU. I trying running the Dev Ray with below command:

ray start --head --num-cpus=2 --num-gpus=1

But I'm not able to see the GPU column on Dashboard. What am I missing here.

[edoakes]

Hey @hegdeashwin I responded on slack, but currently hte column only renders if you have a GPU installed in the cluster

Here is the relevant code that gets GPU usage:
https://github.com/ray-project/ray/blob/master/dashboard/modules/reporter/reporter_agent.py#L191

This will be returned in the proto to the frontend and it doesn't render the GPU column if nothing is returned. It might be nice to add something like a FAKE_GPU_USAGE env variable that would cause this to return some random numbers to test without actually having a GPU.