Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarify memory_limit docs #1207

Merged

Conversation

pentschev
Copy link
Member

It's not currently clear what is the purpose of memory_limit/--memory-limit. This attempts to clarify it's used to spill from host memory to disk.

@pentschev pentschev requested a review from a team as a code owner June 30, 2023 21:17
@github-actions github-actions bot added the python python code needed label Jun 30, 2023
@pentschev pentschev added 3 - Ready for Review Ready for review by team doc Documentation non-breaking Non-breaking change bug Something isn't working and removed bug Something isn't working labels Jun 30, 2023
(bytes), float (fraction of total system memory), string (like ``"5GB"`` or
``"5000M"``), or ``"auto"`` or 0 for no memory management.""",
help="""Size of the host LRU cache, which is used to determine when the worker
starts spilling to disk (not available if JIT-Unspill is enabled). Can be an
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is there any dependency between memory-limit and device-memory-limit, that should be set? like if one cannot be bigger than other etc..

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

memory-limit and device-memory-limit are independent

Copy link
Member

@madsbk madsbk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @pentschev

@pentschev
Copy link
Member Author

Thanks everyone for reviews. @rnyak if you have further suggestions to improve phrasing, please feel free to open an issue or a PR with changes.

@pentschev
Copy link
Member Author

/merge

@rapids-bot rapids-bot bot merged commit e728eb6 into rapidsai:branch-23.08 Jul 4, 2023
18 checks passed
@pentschev pentschev deleted the clarify-memory-limit-docs branch August 25, 2023 07:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team doc Documentation non-breaking Non-breaking change python python code needed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants