Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[core][compiled graphs] Support pinned memory for CPU <-> GPU transfers #48086

Open
stephanie-wang opened this issue Oct 17, 2024 · 5 comments
Open

[core][compiled graphs] Support pinned memory for CPU <-> GPU transfers #48086

stephanie-wang opened this issue Oct 17, 2024 · 5 comments
Labels
compiled-graphs enhancement Request for new feature and/or capability good-first-issue Great starter issue for someone just starting to contribute to Ray P1 Issue that should be fixed within a few weeks

Comments

@stephanie-wang
Copy link
Contributor

stephanie-wang commented Oct 17, 2024 •
edited
Loading

Description

We should support pinning memory for object store memory. This can be done automatically anytime data marked with the TorchTensorType hint is passed between CPU and GPU.

Use case

No response
@stephanie-wang stephanie-wang added enhancement Request for new feature and/or capability triage Needs triage (eg: priority, bug/not-bug, and owning component) good-first-issue Great starter issue for someone just starting to contribute to Ray compiled-graphs P2 Important issue, but not time-critical and removed triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Oct 17, 2024
@kuds
Copy link

kuds commented Oct 21, 2024

I would be interested in adding support for pinned memory to Ray! I'll start digging into the issue and let you know if I have any questions! I will include any development updates and clarifying questions here.

@stephanie-wang
Copy link
Contributor Author

Okay great, I'll assign this issue to you for now @kuds

@kuds
Copy link

kuds commented Nov 4, 2024 •
edited
Loading

@stephanie-wang

I have been digging into this issue/feature for the last few days and will provide a more detailed update about the development progress and design. Just wanted to let you know I was still working on this!

@kuds
Copy link

kuds commented Jan 2, 2025

@stephanie-wang

Just circling back on this issue and am targeting to submit my pull request by end of week

@stephanie-wang stephanie-wang added P1 Issue that should be fixed within a few weeks beta Beta release feture and removed P2 Important issue, but not time-critical labels Jan 21, 2025
@FredrikNoren
Copy link

@kuds Can you share what you found out? I'm interested in this feature as well

@FredrikNoren FredrikNoren mentioned this issue Jan 31, 2025
Open
@jjyao jjyao removed the beta Beta release feture label Feb 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
compiled-graphs enhancement Request for new feature and/or capability good-first-issue Great starter issue for someone just starting to contribute to Ray P1 Issue that should be fixed within a few weeks
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@jjyao @FredrikNoren @stephanie-wang @kuds