Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parallel migration (#18815) #18817

Merged
merged 10 commits into from
Jan 25, 2023
Merged

Parallel migration (#18815) #18817

merged 10 commits into from
Jan 25, 2023

Conversation

peteski22
Copy link

This PR attempts to bring in an OSS contributor's work into Vault, to improve the speed of migration when using vault operator migrate.

Please see the following for further information:

Initial PR: #8857
PR to bring fork into a HashiCorp/Vault branch: #18815
Original Issue: #8883

Co-authored-by: Tomasz Pawelczak [email protected]

* flagParallel sanity check

* Attempt to use ErrGroups

* Updated docs

Co-authored-by: Tomasz Pawelczak <[email protected]>
@peteski22 peteski22 added docs core Issues and Pull-Requests specific to Vault Core core/cli core/migration labels Jan 24, 2023
Copy link
Contributor

@mpalmi mpalmi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From our synchronous review.

command/operator_migrate.go Outdated Show resolved Hide resolved
command/operator_migrate.go Outdated Show resolved Hide resolved
command/operator_migrate.go Outdated Show resolved Hide resolved
Co-authored-by: Mike Palmiotto <[email protected]>
command/operator_migrate.go Outdated Show resolved Hide resolved
command/operator_migrate.go Outdated Show resolved Hide resolved
command/operator_migrate.go Outdated Show resolved Hide resolved
command/operator_migrate.go Show resolved Hide resolved
command/operator_migrate.go Outdated Show resolved Hide resolved
peteski22 added 3 commits January 25, 2023 12:50
* parallel flag renamed to max-parallel
* tests for start + parallel
* removed constraints for start flag and max-parallel flag being used together
* Tweaked some wording
* Removed permit pool
* Removed (re)check of max parallel value in dfsScan
* Updated docs to make it clearer that a high setting might not be honored based on storage backend setting
@peteski22 peteski22 marked this pull request as ready for review January 25, 2023 13:51
@peteski22 peteski22 requested a review from yhyakuna as a code owner January 25, 2023 13:51
command/operator_migrate.go Show resolved Hide resolved
command/operator_migrate.go Show resolved Hide resolved
* Default max-parallel 1 => 10
* Docs updated
* Test folder/paths updated
@peteski22 peteski22 added this to the 1.13.0-rc1 milestone Jan 25, 2023
@peteski22 peteski22 deleted the gites-parallel-migration branch January 25, 2023 15:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core/cli core/migration core Issues and Pull-Requests specific to Vault Core docs enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants