Skip to content

Conversation

@yushengsu-thu
Copy link
Contributor

@yushengsu-thu yushengsu-thu commented Aug 12, 2025

Add this #14 into tms.

…aver_numa/tree/numaFAILED ;                                                 Run test torch_memory_saver_yusheng/test/test_examples.py::test_simple[preload] - assert False

FAILED torch_memory_saver_yusheng/test/test_examples.py::test_cuda_graph[preload] - assert False
FAILED torch_memory_saver_yusheng/test/test_examples.py::test_cpu_backup[preload] - assert False
FAILED torch_memory_saver_yusheng/test/test_examples.py::test_cpu_backup[torch] - assert False
FAILED torch_memory_saver_yusheng/test/test_examples.py::test_multi_device[preload] - assert False
FAILED torch_memory_saver_yusheng/test/test_examples.py::test_multi_device[torch] - assert False
@fzyzcjy
Copy link
Owner

fzyzcjy commented Aug 12, 2025

offline sync:

  • there will be better rocm apis later, thus this is temporary workaround and will be removed later, thus the temporary code duplication is pretty reasonable
  • the memory is not released completely due to bug not yet known, but again since this is temporary code, it is reasonable to merge it now

Copy link
Owner

@fzyzcjy fzyzcjy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I do not check rocm branch and only look at changes to existing code. the nits below are almost only formats instead of real logic, thus may be solved very easily

@fzyzcjy fzyzcjy merged commit 82ee836 into fzyzcjy:master Aug 12, 2025
@EduardDurech
Copy link
Contributor

@yushengsu-thu do you want to modify my setup in SGLang to also support sgl-project/sglang#8813

@yushengsu-thu
Copy link
Contributor Author

@EduardDurech Could we have a quick online call to discuss this (mail: [email protected]
)? At the moment, I only support ROCm 6.3.4 and am also working on ROCm 6.4.2, but I will adopt a more advanced implementation for ROCm ≥ 6.4.2.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants