fix(agentflare-store): embedding write/read endianness mismatch - #256
Merged
Conversation
doc_set_embedding wrote via bytemuck::cast_slice (native-endian) while doc_get_embedding/doc_vec_search read back with hardcoded f32::from_le_bytes. Matched by accident on little-endian hosts, not guaranteed by the code. Flagged in item #148's review, never applied. Write side now builds bytes explicitly via f32::to_le_bytes, matching the read side. Adds a regression test asserting the on-disk byte layout, not just the round trip (which passed before too, on any LE host).
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (1)
📝 WalkthroughWalkthroughEmbedding persistence now converts each ChangesEmbedding storage
Estimated code review effort: 2 (Simple) | ~10 minutes 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Comment |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
doc_set_embeddingwrote embedding bytes viabytemuck::cast_slice(native-endian), whiledoc_get_embedding/doc_vec_searchread them back with a hardcodedf32::from_le_bytes— only matched by luck on little-endian hosts, not guaranteed by the codef32::to_le_bytes, matching the read sideTest plan
cargo test -p agentflare-store— 33/33 passing, including newembedding_bytes_are_stored_little_endianregression test (asserts the actual on-disk byte layout, not just the round trip)cargo build --workspace --all-features— cleanSummary by CodeRabbit
Bug Fixes
Tests