What's Changed
New Features 🎉
- feat: support FTS on multiple fields by @BubbleCal in #3025
- feat: adds support for detached commits by @westonpace in #3028
- feat: add 2.1 read path by @westonpace in #2968
- feat: expose compression-level configuration for general compression by @niyue in #3034
- feat: make it possible to use rowid and rowaddr in filters by @westonpace in #2973
- feat: more flexible and sophisticated handling of non-null constraints by @westonpace in #2467
- feat: support build lance java with rust release mode by @SaintBacchus in #3051
- feat: do brute force search on unindexed data by @BubbleCal in #3036
- feat: bitpack with miniblock by @broccoliSpicy in #3067
- feat: introduce concept of "storage class" wtih separate dataset for "blob" storage data by @westonpace in #3064
- feat: add max length statistics to VariableWidth Datablock by @broccoliSpicy in #3082
- feat: add support for "take" operation to balanced storage by @westonpace in #3079
- feat: enable write variable width data in 2.1 by @broccoliSpicy in #3090
- feat: add compaction support to balanced datasets by @westonpace in #3088
- feat: align buffers in 2.1 files by @westonpace in #3101
- feat: allow inserting subschemas by @wjones127 in #3041
- feat: support miniblock with binary data by @broccoliSpicy in #3099
- feat: add full zip encoding for wide data types by @westonpace in #3114
- feat: fsst compression with mini-block by @broccoliSpicy in #3121
Bug Fixes 🐛
- fix: fix the incorrect assertion for fixed size binary decoder by @niyue in #3050
- fix: verify num_sub_vectors is valid before creating index by @westonpace in #3056
- fix: always return correct batch size by @westonpace in #3066
- fix: fp16 GPU training by @chebbyChefNEQ in #3105
Performance Improvements 🚀
- perf: use total cmp for ordered float by @chebbyChefNEQ in #3059
- perf: parallel search partitions in subindex by @chebbyChefNEQ in #3060
- perf: implement fast path for union many row id tree map by @chebbyChefNEQ in #3087
- perf: transpose the PQ codes to improve search performance by @BubbleCal in #3120
Other Changes
- refactor: fix confusing impl of indexed_fragments by @wjones127 in #3047
Full Changelog: v0.19.1...v0.19.2