Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ensure filter occurs before sort #204

Merged
merged 1 commit into from
Jun 14, 2023

Conversation

robfitzgerald
Copy link
Collaborator

@robfitzgerald robfitzgerald commented Jun 14, 2023

a quick fix. these error messages were observed for larger-running scenarios:

enqueue.pdf

a combined filter + sort was being applied to a collection where it was assumed that the filter occurred before the sort. this behavior was swapped in the recent determinism refactor. this fix ensures filters are applied before the sorts, which should be the default behavior (downsampling the size of $n$ before applying a $O(n\ \log\ n)$ operation is more performant).

Copy link
Collaborator

@nreinicke nreinicke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense to me, thanks for tracking that down

@robfitzgerald robfitzgerald merged commit 87286cb into main Jun 14, 2023
@robfitzgerald robfitzgerald deleted the rjf/bugfix-sort-filter-ordering branch June 14, 2023 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants