Skip to content

Increase TypedSet expectedSize in DynamicFilterSourceOperator#17086

Merged
raunaqmorarka merged 1 commit intotrinodb:masterfrom
raunaqmorarka:dfso-set-size
Apr 19, 2023
Merged

Increase TypedSet expectedSize in DynamicFilterSourceOperator#17086
raunaqmorarka merged 1 commit intotrinodb:masterfrom
raunaqmorarka:dfso-set-size

Conversation

@raunaqmorarka
Copy link
Copy Markdown
Member

Description

Current initial size of 8 is very small and leads to unnecessary amount of rehashing

Benchmark                                                  (collectionLimits)  (positionsPerPage)  Mode  Cnt  Before Score   After Score     Units
BenchmarkDynamicFilterSourceOperator.dynamicFilterCollect              5000,0                1024  avgt   45   0.663 ± 0.133  0.257 ± 0.017  ms/op
BenchmarkDynamicFilterSourceOperator.dynamicFilterCollect             50000,0                1024  avgt   45   6.420 ± 0.956  3.703 ± 0.139  ms/op
BenchmarkDynamicFilterSourceOperator.dynamicFilterCollect           1000000,0                1024  avgt   45  38.821 ± 2.883 32.224 ± 1.992  ms/op

Additional context and related issues

Release notes

(x) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

Current initial size of 8 is very small and leads to unnecessary
amount of rehashing

Benchmark                                                  (collectionLimits)  (positionsPerPage)  Mode  Cnt  Before Score   After Score     Units
BenchmarkDynamicFilterSourceOperator.dynamicFilterCollect              5000,0                1024  avgt   45   0.663 ± 0.133  0.257 ± 0.017  ms/op
BenchmarkDynamicFilterSourceOperator.dynamicFilterCollect             50000,0                1024  avgt   45   6.420 ± 0.956  3.703 ± 0.139  ms/op
BenchmarkDynamicFilterSourceOperator.dynamicFilterCollect           1000000,0                1024  avgt   45  38.821 ± 2.883 32.224 ± 1.992  ms/op
@raunaqmorarka raunaqmorarka merged commit f992ba1 into trinodb:master Apr 19, 2023
@raunaqmorarka raunaqmorarka deleted the dfso-set-size branch April 19, 2023 03:01
@github-actions github-actions bot added this to the 414 milestone Apr 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Development

Successfully merging this pull request may close these issues.

2 participants