Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write Amplification factor for small key-values with frequent writes to levelDB #1143

Open
bhogi50 opened this issue Sep 1, 2023 · 0 comments

Comments

@bhogi50
Copy link

bhogi50 commented Sep 1, 2023

Hi Team,

I am facing a serious issue with write amplification. Consider, There are key-values that will write to levelDB for every 5 seconds. Those key-values are always batched into a write_batch object and then written to levelDB using leveldb_write() for every 5 sec. You can assume total size of key-values will be 500 bytes.

With leveldb ( sync = false ) , I am getting eMMC write count of 221 writes. where, If I write values directly into eMMC by maintaining some offsets for each value, I am getting eMMC write count of 70 writes.

The difference is Huge. Is there any way to optimize leveldb eMMC write count ? FYI, I tried all options available in Options.h file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant