-
-
Notifications
You must be signed in to change notification settings - Fork 732
[stats] Rewrite stat management to use single threaded event loop #8815
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
149 commits
Select commit
Hold shift + click to select a range
796564b
[stats] event loop
max-hoffman 5034635
more progress
max-hoffman 8de66e4
basic scheduler test working
max-hoffman d6882e4
analyze
max-hoffman 4c5bd3f
add/drop hooks
max-hoffman c2876de
gc
max-hoffman 4d8d8f0
delete an alter
max-hoffman bb6ab3c
drop index and table
max-hoffman 542bc40
fix other tests
max-hoffman 14cf9fd
branch management
max-hoffman d949b3d
starter for kv
max-hoffman 397aaa9
gc and refactor maintanance
max-hoffman 16ff4ff
fix bucket doubling
max-hoffman 1d04f74
delete log
max-hoffman 2be37c1
better bucket counting
max-hoffman ee16cf1
test for disk round trip
max-hoffman d18b524
more prolly stats gc tests
max-hoffman ee2286b
rotate backing stats db
max-hoffman 4a91332
progress towards swapping old for new, deleting old code
max-hoffman 128efd5
fix gc bucket overflow
max-hoffman 347d3f5
test for gc overflow
max-hoffman 9bdb958
org and closers
max-hoffman d503c4e
save progress update
max-hoffman 76a45ff
finally get first two bats running
max-hoffman 373aa9a
startup bound hash issue
max-hoffman c56dd06
rewrite GC to be synchronous, fix more bugs
max-hoffman 14eae29
fix session freshness
max-hoffman 6ab5193
fix branch gc
max-hoffman 474a85f
cache writes and gc are serialized
max-hoffman d8e6c09
fix gc/branch update dropped hashes
max-hoffman 31d3780
fix gc race, doubling race, jobs race
max-hoffman c2c4f05
fix more races
max-hoffman e23cf1f
docs
max-hoffman 4da767b
convert bats to script tests
max-hoffman 8d3c07f
more tests, purge/stop
max-hoffman 6578011
validate
max-hoffman aafeec7
docs
max-hoffman 6dd1fb4
some PR cleanup
max-hoffman 4635cfa
more cleanup
max-hoffman ec8ed11
stash for pull
max-hoffman c95fcda
merge
max-hoffman 2e424eb
fix bucket hash conflicts
max-hoffman e849f27
Fix more collection bugs.
max-hoffman 8224b09
bump, timer proc
max-hoffman 43e739d
more test fixes
max-hoffman b209532
cache bats changes
max-hoffman 043c174
merge main
max-hoffman 7291054
Another deadlock
max-hoffman 40cdce0
delete comment
max-hoffman d040cfa
fmt
max-hoffman 6df2999
no read replica stats
max-hoffman fe72f62
fix plan tests
max-hoffman 1be0f49
branch qualified analyze fix
max-hoffman 7a35c3d
[no-release-notes] go: statspro/jobqueue: Create a SerialQueue, which…
reltuk 468dafc
go: statspro/jobqueue: A bit of cleanup, fix a flakey test.
reltuk 9c595c9
Merge branch 'aaron/jobqueue' into max/stats-event-loop
max-hoffman efa0412
rewrite with GDQ
max-hoffman e3811ee
prog
max-hoffman f46a1c4
tests run
max-hoffman ad9ed8e
fix info and storage
max-hoffman 4910909
outline for gc impl
max-hoffman c31dd08
fix tests and races
max-hoffman 6d2ea07
bump
max-hoffman f171a50
better error and panic management
max-hoffman 8d8398a
better start/stop/wait
max-hoffman d637699
Add rate limiting
max-hoffman 3c5f1a9
gc ticker
max-hoffman aa23dde
docs
max-hoffman 4f926d3
doc
max-hoffman 9e260cb
test prog
max-hoffman 8a64097
fix more tests
max-hoffman 9b3a8cb
finish up listener tests
max-hoffman ff64cfb
add comments
max-hoffman 99c4e91
gc concurrency
max-hoffman f070e05
enginetests and statspro tests passing
max-hoffman 791dff0
simplify listeners
max-hoffman c394276
bats progress
max-hoffman f53de92
small edits
max-hoffman 7e58b09
tests progress
max-hoffman 8e48425
merge main
max-hoffman e666a48
bats are running
max-hoffman 40930aa
fmt
max-hoffman 28947eb
build
max-hoffman 1823dcc
edits
max-hoffman 9535ffb
fix interface
max-hoffman a20401f
merge main
max-hoffman 2c3c271
fix build
max-hoffman 2d02535
stats alternate index types
max-hoffman 258f5e9
fix mem test
max-hoffman 5775bfe
tidy
max-hoffman 002ece8
build
max-hoffman f656924
fix more tests
max-hoffman 39ee000
fmt
max-hoffman 380c51b
more fmt
max-hoffman 657c032
merge main
max-hoffman 2a32486
merge main
max-hoffman a28f36f
copyright
max-hoffman e3295a6
license
max-hoffman 4e12e77
Merge branch 'main' into max/stats-event-loop
max-hoffman 7e1d1b7
fix races
max-hoffman 10f8bc3
syntax error
max-hoffman 10e67a7
fix windows path
max-hoffman 6b36433
nil mcv panic
max-hoffman 58879d6
fix test races
max-hoffman e9d58f2
bump def job interval to 30ms
max-hoffman 4d76ab2
deterministic tests
max-hoffman 0e4c2e5
more tests
max-hoffman 11bbba7
TEMP COMMIT: valctx plus some other stuff...
reltuk f07fef3
Merge branch 'aaron/nbs-session-lifecycle-sanity-checks' into max/sta…
max-hoffman bb69370
shorter concurrency tests
max-hoffman 687f497
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/upda…
max-hoffman e73931a
nondeterministic test
max-hoffman 7864cf1
Merge branch 'max/stats-event-loop' of github.com:dolthub/dolt into m…
max-hoffman b13e8cf
try to make queue tests less racy
max-hoffman 6c8a0db
missed one start
max-hoffman c36381b
stats granular session locks
max-hoffman d1631d4
simplify a little
max-hoffman 9e15822
merge main
max-hoffman 7b68907
try to avoid serialq test deadlock
max-hoffman 7579620
merge main
max-hoffman 15d51a6
try to fix flakes
max-hoffman 66e8c71
more races
max-hoffman a35b9c7
bump
max-hoffman 9923a6e
merge and worker batch
max-hoffman cd6fb69
merge main
max-hoffman 73db71f
another race
max-hoffman 0772a00
cleanup
max-hoffman 3f238d0
more cleanup
max-hoffman ac16aca
revert ctx validation
max-hoffman 8591963
most zach comments
max-hoffman 6ba5996
more comments
max-hoffman 06d3419
more race
max-hoffman ca41655
Merge branch 'main' into max/stats-event-loop
max-hoffman 22d7801
bump
max-hoffman 0fb4128
merge main
max-hoffman 91f0cf6
more race
max-hoffman a8fd924
bump
max-hoffman de47ba3
merge main
max-hoffman 2a75378
schemas
max-hoffman 4d0bab5
skip windows racees
max-hoffman 05bcf2c
standardize server config init, use background threads management
max-hoffman c701726
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/upda…
max-hoffman cb57493
merge main
max-hoffman f71fbd5
Merge branch 'max/stats-event-loop' of github.com:dolthub/dolt into m…
max-hoffman a4d4f72
default stats noop
max-hoffman 252efd0
threads management improvements
max-hoffman 8fd7a05
undo change
max-hoffman bc7f15a
move stats initialization back to engine
max-hoffman 73fcedc
[ga-format-pr] Run go/utils/repofmt/format_repo.sh and go/Godeps/upda…
max-hoffman File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Kind of a large change. Not necessarily opposed, but is this strictly to accommodate VectorIndexes? And if so, is there a less intrusive change that accomplishes it?
Seems like a panic is as good as an error for catching this kind of mismatch in logic where it needs to be updated.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I mean i can undo it and handle it separately for stats if you'd prefer. I'd be surprised if this doesn't also affect merges and schema changes