-
Notifications
You must be signed in to change notification settings - Fork 31
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update compression method and expose badger options #31
Conversation
a9kitkumarsinha
commented
Jun 11, 2020
•
edited
Loading
edited
- Use zlip compression
- Expose badger options as
- Add statsd metrics for
- Keys addes
- Keys deleted
- Compaction latency
- Delete key latency
internal/config/config.go
Outdated
MaxTableSize *int64 `json:"maxTableSize" yaml:"maxTableSize" env:"MAXTABLESIZE"` // maximum size in bytes for each LSM table or file. | ||
LevelOneSize *int64 `json:"levelOneSize" yaml:"levelOneSize" env:"LEVELONESIZE"` // maximum total size in bytes for Level 1. defaults to 1 Million | ||
LevelSizeMultiplier *int `json:"levelSizeMultiplier" yaml:"levelSizeMultiplier" env:"LEVELSIZEMULTIPLIER"` // the ratio between the maximum sizes of contiguous levels in the LSM. defaults to 10 | ||
MaxLevels *int `json:"maxLevels" yaml:"maxLevels" env:"MAXLEVELS"` // maximum number of levels of compaction allowed in the LSM. defaults to 7 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we add something like
Defaults string `json:"defaults" yaml:"defaults" env:"DEFAULTS"`
which would essentially be one of 3 possible values badger
, ingestion
, storage
and switch either badger.DefaultOptions(dir)
or 2 other sets of constant values.
I know it's making it a bit specific for our use-cases, but I'd rather not loose the track of the tuned parameters we have and we can interate from here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM