-
Notifications
You must be signed in to change notification settings - Fork 2.1k
[Feature][Zeta] Replace Imap by RocksDB #9988
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: dev
Are you sure you want to change the base?
Conversation
|
Hi @Hisoka-X @zhangshenghang @liugddx, please take a look when you have time. Thanks! |
|
The configuration file is migrated from hazelcast.yaml to seatunnel.yaml, which is a breaking change.Can we provide a configuration migration tool or script? |
|
It is recommended to be compatible with both methods at the same time and consider being compatible with the old configuration for a period of time. |
The design document can be found in the Apache dev mailing list. For compatibility, I’ll make the configuration still available in hazelcast.yaml for now. |
|
Hi @hawk9821 , PTAL when you have a moment. Thanks! |
Fixes: #9851
Purpose of this pull request
This PR implements the basic RocksDB storage layer.
After gathering feedback, I plan to further improve the storage code and migrate other Imap instances to RocksDB, updating the documentation along the way.
Does this PR introduce any user-facing change?
Yes.
Users should now configure map-store settings in
seatunnel.yamlinstead ofhazelcast.yaml.How was this patch tested?
Added RocksDBServiceTest.
Check list
New License Guide