Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue when using ray tune in Kaggle with GPU #37452

Open
NUIST-elite opened this issue Jul 15, 2023 · 4 comments
Open

Issue when using ray tune in Kaggle with GPU #37452

NUIST-elite opened this issue Jul 15, 2023 · 4 comments
Labels
stale The issue is stale. It will be closed within 7 days unless there are further conversation

Comments

@NUIST-elite
Copy link

When I want to use ray tune in kaggle notebook, there will be following errors:

import ray
ray.init()

2023-07-15 15:17:02,721 ERROR services.py:1207 -- Failed to start the dashboard , return code -11
2023-07-15 15:17:02,726 ERROR services.py:1232 -- Error should be written to 'dashboard.log' or 'dashboard.err'. We are printing the last 20 lines for you. See 'https://docs.ray.io/en/master/ray-observability/ray-logging.html#logging-directory-structure' to find where the log file is.
2023-07-15 15:17:02,729 ERROR services.py:1276 --
The last 20 lines of /tmp/ray/session_2023-07-15_15-16-58_607926_29/logs/dashboard.log (it contains the error message from the dashboard):
2023-07-15 15:17:02,585 INFO head.py:242 -- Starting dashboard metrics server on port 44227
2023-07-15 15:17:04,019 INFO worker.py:1636 -- Started a local Ray instance.

After checking, there are following patterns:
1, If using ray tune 2.2.0, there will be no problem, with or without GPU turned on
2. If using ray 2.5.1, when GPU is turned on, this error will occur.

@Apoiuty
Copy link

Apoiuty commented Jul 16, 2023

I've also encountered the same issue. Have you resolved it?

@bigboss98
Copy link

I've also encountered the same issue. Have you find a solution?

@prayaspatnaik21
Copy link

Struggling with the same issue. Any update?

Copy link

stale bot commented Feb 1, 2025

Hi, I'm a bot from the Ray team :)

To help human contributors to focus on more relevant issues, I will automatically add the stale label to issues that have had no activity for more than 4 months.

If there is no further activity in the 14 days, the issue will be closed!

  • If you'd like to keep the issue open, just leave any comment, and the stale label will be removed!
  • If you'd like to get more attention to the issue, please tag one of Ray's contributors.

You can always ask for help on our discussion forum or Ray's public slack channel.

@stale stale bot added the stale The issue is stale. It will be closed within 7 days unless there are further conversation label Feb 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stale The issue is stale. It will be closed within 7 days unless there are further conversation
Projects
None yet
Development

No branches or pull requests

4 participants