feat: add support for large minichunk size (u32) in format v2.2#4959

Merged

Xuanwo merged 8 commits intolance-format:mainfrom

niyue:feature/large-chunk

Dec 17, 2025

Commits on Nov 17, 2025

Make binary mini block chunk size configurable.
niyue
committed
Make 64kb binary atim minichunk size for binary to be possible.
niyue
committed
Change miniblock chunk's buffer sizes to be u32 so that it is possible to enlarge chunk size to be over 64kb
niyue
committed
Add support_large_chunk for version 2.2 miniblock so that users can choose larger chunk size if needed.
niyue
committed
Make binary mini chunk size configurable via field metadata
niyue
committed
Refactor WordsIter to be a struct so that we can avoid `match` U16/U32 for every `next` and this is more efficient during iteration.
niyue
committed
Rename the parameter to has_large_chunk for decoding path, and use minichunk_size instead of binary_minichunk_size to make it more general.
niyue
committed

Commits on Dec 17, 2025

Merge branch 'main' into feature/large-chunk
Xuanwo
authored