Skip to content

Expose the variants of binary indexes to the C API.#2

Closed
aalekhpatel07 wants to merge 0 commit intoEnet4:mainfrom
aalekhpatel07:c_api/binary-indexes
Closed

Expose the variants of binary indexes to the C API.#2
aalekhpatel07 wants to merge 0 commit intoEnet4:mainfrom
aalekhpatel07:c_api/binary-indexes

Conversation

@aalekhpatel07
Copy link

No description provided.

Enet4 pushed a commit that referenced this pull request Aug 30, 2025
…Lists (facebookresearch#3327)

Summary:
Pull Request resolved: facebookresearch#3327

**Context**
1. [Issue 2621](facebookresearch#2621) discuss inconsistency between OnDiskInvertedList and InvertedList. OnDiskInvertedList is supposed to handle disk based multiple Index Shards. Thus, we should name it differently when merging invls from index shard.
2. [Issue 2876](facebookresearch#2876) provides usecase of shifting ids when merging invls from different shards.

**In this diff**,
1. To address #1 above, I renamed the merge_from function to merge_from_multiple without touching merge_from base class.
why so? To continue to allow merge invl from one index to ondiskinvl from other index.

2. To address #2 above, I have added support of shift_ids in merge_from_multiple to shift ids from different shards. This can be used when each shard has same set of ids but different data. This is not recommended if id is already unique across shards.

Reviewed By: mdouze

Differential Revision: D55482518

fbshipit-source-id: 95470c7449160488d2b45b024d134cbc037a2083
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant