Skip to content
This repository was archived by the owner on Jan 22, 2025. It is now read-only.

Snapshot optimizations#5525

Merged
carllin merged 4 commits into
solana-labs:masterfrom
carllin:SnapshotOptimizations
Aug 15, 2019
Merged

Snapshot optimizations#5525
carllin merged 4 commits into
solana-labs:masterfrom
carllin:SnapshotOptimizations

Conversation

@carllin
Copy link
Copy Markdown
Contributor

@carllin carllin commented Aug 14, 2019

Problem

Serialization in Rust tar does not support adding sparse files and crashes on archives bigger than 4GB

Summary of Changes

Call a shell command to tar snapshots instead.

Fixes #

@carllin carllin requested a review from sagar-solana August 14, 2019 21:52
@carllin carllin force-pushed the SnapshotOptimizations branch from d98ee47 to ae7cb51 Compare August 14, 2019 21:53
Comment thread core/src/snapshot_package.rs Outdated
.suffix(".tgz")
.tempfile_in(tar_dir)?;
let temp_tar_path = temp_tar_gz.path();
let mut args = vec!["zcfhS"];
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This'll be j instead of z (and tar_bz2) once #5515 lands

@codecov
Copy link
Copy Markdown

codecov Bot commented Aug 14, 2019

Codecov Report

Merging #5525 into master will decrease coverage by 2.2%.
The diff coverage is 60.6%.

@@           Coverage Diff            @@
##           master   #5525     +/-   ##
========================================
- Coverage    76.1%   73.9%   -2.3%     
========================================
  Files         214     214             
  Lines       41285   42501   +1216     
========================================
- Hits        31452   31427     -25     
- Misses       9833   11074   +1241

@carllin carllin force-pushed the SnapshotOptimizations branch from ae7cb51 to dccb902 Compare August 15, 2019 05:26
@carllin carllin force-pushed the SnapshotOptimizations branch from dccb902 to 963f117 Compare August 15, 2019 05:31
@carllin carllin merged commit 4688f98 into solana-labs:master Aug 15, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants