Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix allocation failures during sorting with spill-to-disk #12288

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

cjolowicz
Copy link

@cjolowicz cjolowicz commented Sep 2, 2024

Which issue does this PR close?

Closes #12136.
Closes #10073.

Rationale for this change

See the issues.

What changes are included in this PR?

This change replaces try_resize with resize in three sites, allowing memory to overshoot the configured pool size. These are sites where we don't fall back to spilling to disk when the allocation fails.

Are these changes tested?

TBD

Are there any user-facing changes?

No

This change replaces `try_resize` with `resize` in three sites, allowing memory
to overshoot the configured pool size. These are sites where we don't fall back
to spilling to disk when the allocation fails.

Fixes: apache#12136
@github-actions github-actions bot added the physical-expr Physical Expressions label Sep 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
physical-expr Physical Expressions
Projects
None yet
Development

Successfully merging this pull request may close these issues.

External sorting not working for (maybe only for string columns??) Memory account not adding up in SortExec
1 participant