Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Filestore] implement blob compression #2777

Draft
wants to merge 24 commits into
base: main
Choose a base branch
from
Draft

[Filestore] implement blob compression #2777

wants to merge 24 commits into from

Conversation

SvartMetal
Copy link
Collaborator

@SvartMetal SvartMetal commented Dec 29, 2024 •
edited
Loading

#9

@SvartMetal SvartMetal marked this pull request as draft December 29, 2024 00:25
@SvartMetal SvartMetal added the large-tests Launch large tests for PR label Dec 29, 2024
@github-actions GitHub Actions
Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit b1b5d6c.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
6677 6677 0 0 0 0

@github-actions GitHub Actions
Copy link
Contributor

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 4b5c233.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
6678 6678 0 0 0 0

Mikhail Montsev and others added 24 commits January 1, 2025 11:23
@SvartMetal
add TBlobCompressionInfo to TMixedBlobMeta
be85b59
@SvartMetal
compress blobs during compaction
531c9a5
@SvartMetal
add TBlobCompressionInfo to IMixedBlocksVisitor
fc03544
@SvartMetal
simplify ReadBlob actor
a241102
@SvartMetal
use TBlobCompressionInfo::BlobCompressed() method instead of operator…
a088d70 
… bool
@SvartMetal
code is simpler if TReadBlobActor uses TVector<TReadBlob::TBlock> ins…
e144e8c 
…tead of TVector<ui32> of block offsets
@SvartMetal
use c_str instead of data in TReadBlobActor
85cb495
@SvartMetal
extract ReadUncompressedResponse function from TReadBlobActor::Handle…
d3b845c 
…GetResult
@SvartMetal
use TEvGetQueryInfo::BlockOffsets instead of TReadBlobRequest::Blocks
8f8b14a
@SvartMetal
minor tweak
0018328
@SvartMetal
Use TReadBlob::TBlock instead of block offset (ui64) in TEvGetQueryInfo
0d14ad9
@SvartMetal
pass TBlobCompressionInfo to TReadBlobRequest
b55cafc
@SvartMetal
further refactoring: rename TEvGetQueryInfo to TQuery and Offset, Siz…
c60c2df 
…e to use it for decompression
@SvartMetal
decompress data in TReadBlobActor
220c493
@SvartMetal
get rid of TQuery::Compressed flag
5d3a58a
@SvartMetal
introduce TBlobCompressionInfo::TImpl
6edaf47
@SvartMetal
TBlobCompressionInfo should use shared_ptr instead of unique_ptr
2e971d2
@SvartMetal
TBlobCompressionInfo should store encoded data using TByteVector
3ffcf38
@SvartMetal
split TUncompressedRange and TCompressedRange
34f6b6b
@SvartMetal
add EAllocatorTag::BlobCompressionInfo
78bfd3e
@SvartMetal
fix blob size after compression; implement 'identity' compression alg…
ad11b22 
…orithm (needed to check correctness of the refactoring)
@SvartMetal
add service-kikimr-compression-test
87e2cb0
@SvartMetal
fix bug and implement simple 'whole blob' compression algorithm
5f8c7f8
@SvartMetal
FlushBytes should respect TBlobCompressionInfo; fix subtle bug with m…
302119c 
…issing TBlobCompressionInfo in UpdateBlockLists
@SvartMetal SvartMetal force-pushed the users/svartmetal/issue-9/4 branch from e0d3611 to 302119c Compare January 1, 2025 13:10
@SvartMetal SvartMetal self-assigned this Jan 1, 2025
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jan 1, 2025

Note

This is an automated comment that will be appended during run.

🟢 linux-x86_64-relwithdebinfo: all tests PASSED for commit 302119c.

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
6681 6681 0 0 0 0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@SvartMetal SvartMetal

Labels
large-tests Launch large tests for PR
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@SvartMetal