Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tweak some coefficients #124

Merged
merged 3 commits into from
Nov 5, 2019
Merged

Tweak some coefficients #124

merged 3 commits into from
Nov 5, 2019

Conversation

bboreham
Copy link
Contributor

@bboreham bboreham commented Nov 4, 2019

Double the number of neighbours we gossip to, for improved coverage.

Previously a 3-node cluster would send to 1 peer each time, and a 7-node cluster to 2, so information could take a while to get everywhere.

This calculation maintains the spirit that the number grows slowly in larger clusters - in a 100-node cluster each node will gossip to 12.

Slow down accepting new connections, to reduce peak memory usage.

When 100 connections arrive at once, each one sends the whole topology and we read it all into memory at once then try to relay new information out again.

These new parameters mean we will take 4 seconds to accept 100 connections, and 9 seconds to accept 200, so the system has time to process each message without spiking memory.

Previously a 3-node cluster would send to 1 peer each time, and a
7-node cluster to 2, so information could take a while to get
everywhere.

This calculation maintains the spirit that the number grows slowly in
larger clusters - in a 100-node cluster each node will gossip to 12.
When 100 connections arrive at once, each one sends the whole topology
and we read it all into memory at once then try to relay new
information out again.

These new parameters mean we will take 4 seconds to accept 100
connections, and 9 seconds to accept 200, so the system has time to
process each message without spiking memory.
routes.go Show resolved Hide resolved
@bboreham bboreham merged commit 58dbcc3 into master Nov 5, 2019
@bboreham bboreham deleted the tweak-coefficients branch November 5, 2019 12:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants