Fetch upstream main#1

Merged

tarang-jain merged 206 commits intotarang-jain:mainfrom

facebookresearch:main

Jun 18, 2024

Commits on Dec 12, 2023

Upstream changes to big batch search (#3170)

mlomeli1
authored and
facebook-github-bot
committed

Commits on Dec 18, 2023

Offline IVF powered by faiss big batch search (#3175)

mlomeli1
authored and
facebook-github-bot
committed

Commits on Dec 21, 2023

Remove unused function from faiss/impl/ProductQuantizer.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused function from faiss/utils/quantize_lut.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Dec 22, 2023

Back out "Offline IVF powered by faiss big batch search"

algoriddle
authored and
facebook-github-bot
committed

Commits on Dec 23, 2023

Adding [[fallthrough]] annotation to case statements in faiss/utils/hamming_distance/generic-inl.h

Jason Sylka
authored and
facebook-github-bot
committed

Commits on Dec 26, 2023

Adding [[fallthrough]] annotation to case statements in faiss/utils/hamming_distance/neon-inl.h

EddyLXJ
authored and
facebook-github-bot
committed

Commits on Dec 27, 2023

Add missing fallthrough to fbcode/faiss/utils/hamming_distance/neon-inl.h

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 3, 2024

Remove unused exception parameter from files inc facer/engine/utils/StatsD.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 5, 2024

faiss paper benchmarks (#3189)

algoriddle
authored and
facebook-github-bot
committed

Commits on Jan 8, 2024

Fix shadowed variable in faiss/impl/simd_result_handlers.h

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 9, 2024

Commits on Jan 11, 2024

avx512 CI + conda packages (#3197)

algoriddle
authored and
facebook-github-bot
committed
Generalize ResultHanlder, support range search for HNSW and Fast Scan (#3190)

mdouze
authored and
facebook-github-bot
committed
Add SIMD NEON Optimization for QT_FP16 in Scalar Quantizer (#3166)

naveentatikonda
authored and
facebook-github-bot
committed

Commits on Jan 13, 2024

bump libraft version to fix nightly

algoriddle
authored and
facebook-github-bot
committed

Commits on Jan 14, 2024

Commits on Jan 16, 2024

Commits on Jan 17, 2024

doc update to mention the paper

mdouze
authored and
facebook-github-bot
committed

Commits on Jan 18, 2024

Remove unused variables in faiss/utils/hamming.cpp

r-barnes
authored and
facebook-github-bot
committed
add gpu to avx512 (#3210)

algoriddle
authored and
facebook-github-bot
committed
Use packaging instead of deprecated distutils for version handling (#3191)

kyamagu
authored and
facebook-github-bot
committed

Commits on Jan 19, 2024

Fix shadowed variable in faiss/clone_index.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 21, 2024

Mismatch tags take 2 (#3211)

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 22, 2024

fix raft build

algoriddle
authored and
facebook-github-bot
committed

Commits on Jan 23, 2024

Remove extra semi colon from faiss/invlists/InvertedLists.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove extra semi colon from faiss/python/python_callbacks.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove extra semi colon from faiss/utils/distances_simd.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove extra semi colon from faiss/Clustering.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove extra semi colon from faiss/IndexIVFFastScan.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/impl/index_read.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/impl/index_write.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/IndexIVFFastScan.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/impl/HNSW.cpp

r-barnes
authored and
facebook-github-bot
committed
Fix shadowed variable in faiss/IndexIDMap.cpp

r-barnes
authored and
facebook-github-bot
committed
Fix shadowed variable in faiss/IndexNSG.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/IndexShardsIVF.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 24, 2024

Remove unused variables in faiss/IndexBinaryHash.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/utils/sorting.cpp

r-barnes
authored and
facebook-github-bot
committed
Fix AVX512 build targets in CMakeLists.txt (#3214)

kyamagu
authored and
facebook-github-bot
committed
Fix shadowed variable in faiss/utils/utils.cpp

r-barnes
authored and
facebook-github-bot
committed
Fix shadowed variable in faiss/impl/ResultHandler.h

r-barnes
authored and
facebook-github-bot
committed
Fix shadowed variable in faiss/impl/residual_quantizer_encode_steps.cpp

r-barnes
authored and
facebook-github-bot
committed
Fix shadowed variable in faiss/IndexAdditiveQuantizerFastScan.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove extra semi colon from faiss/index_factory.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove extra semi colon from faiss/IndexIVFSpectralHash.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused function from faiss/clone_index.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 25, 2024

Commits on Jan 27, 2024

Remove extra semi colon from faiss/impl/ProductAdditiveQuantizer.h

r-barnes
authored and
facebook-github-bot
committed

Commits on Jan 30, 2024

Commits on Jan 31, 2024

cuda dependencies (#3230)

algoriddle
authored and
facebook-github-bot
committed

Commits on Feb 2, 2024

HNSW search use efSearch from params if provided (#3233)

xinhuitian
authored and
facebook-github-bot
committed
faiss-gpu to use 11.4.4 and be the only one supporting P100 (#3237)

algoriddle
authored and
facebook-github-bot
committed

Commits on Feb 9, 2024

pin circleci windows image (#3248)

algoriddle
authored and
facebook-github-bot
committed
add a context parameter to InvertedLists and InvertedListsIterator (#3247)

bladepan
authored and
facebook-github-bot
committed

Commits on Feb 13, 2024

Add feature in IndexIDMap.cpp range_search with Parameters. (#3213)

yuhaijun999
authored and
facebook-github-bot
committed
fix omp parallelism in fast scan range search

algoriddle
authored and
facebook-github-bot
committed

Commits on Feb 14, 2024

libraft 24.02 is released, switching channel

algoriddle
authored and
facebook-github-bot
committed
Remove semicolon(s) from 3 files inc facer/engine/utils/UDPServer.h

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/tests/test_threaded_index.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Feb 15, 2024

Remove unused variables in faiss/IndexIVF.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/IndexBinaryIVF.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/IndexIVFPQ.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/invlists/OnDiskInvertedLists.cpp

r-barnes
authored and
facebook-github-bot
committed
Remove unused variables in faiss/utils/hamming_distance/neon-inl.h

r-barnes
authored and
facebook-github-bot
committed
fix perf test (#3253)

algoriddle
authored and
facebook-github-bot
committed
Remove unused variables in faiss/utils/partitioning.cpp

r-barnes
authored and
facebook-github-bot
committed
fix perf test (#3255)

algoriddle
authored and
facebook-github-bot
committed
Fix AVX2 build on Windows (#3238)

borrrden
authored and
facebook-github-bot
committed

Commits on Feb 21, 2024

Integrate IVF-PQ from RAFT (#3044)

tarang-jain
authored and
facebook-github-bot
committed
fixes for D51074065

algoriddle
authored and
facebook-github-bot
committed
faiss gpu: fix DeviceVector reallocations (#3256)

Jeff Johnson
authored and
facebook-github-bot
committed

Commits on Feb 29, 2024

Prepare for v.1.8.0 release (#3265)

junjieqi
authored and
facebook-github-bot
committed

Commits on Mar 1, 2024

Skip HNSWPQ sdc init with new io flag (#3250)

jmazanec15
authored and
facebook-github-bot
committed

Commits on Mar 4, 2024

Change intall.md to reflect faiss 1.8.0

junjieqi
authored and
facebook-github-bot
committed

Commits on Mar 15, 2024

AIX compilation fix for io classes (#3275)

ranjitsastra
authored and
facebook-github-bot
committed

Commits on Mar 18, 2024

Removed index_shard_and_quantize OIVFBBS (#3291)

mlomeli1
authored and
facebook-github-bot
committed
Dim reduction support in OIVFBBS (#3290)

mlomeli1
authored and
facebook-github-bot
committed

Commits on Mar 19, 2024

Remove swig version and always rely on the latest version (#3295)

junjieqi
authored and
facebook-github-bot
committed
Remove unused fallthrough (#3296)

junjieqi
authored and
facebook-github-bot
committed
Revert D54973709: Remove unused fallthrough

Jason Sylka
authored and
facebook-github-bot
committed
Back out "Remove swig version and always rely on the latest version" (#3297)

junjieqi
authored and
facebook-github-bot
committed

Commits on Mar 20, 2024

Use cmake's find_package to link to GTest (#3278)

yurivict
authored and
facebook-github-bot
committed
RAFT 24.04 API changes (#3282)

divyegala
authored and
facebook-github-bot
committed

Commits on Mar 21, 2024

Remove TypedStorage usage when working with torch_utils (#3301)

ramilbakhshyiev
authored and
facebook-github-bot
committed
move to raft 24.04 (#3302)

algoriddle
authored and
facebook-github-bot
committed

Commits on Mar 22, 2024

Fix HNSW stats (#3309)

mdouze
authored and
facebook-github-bot
committed
Handling FaissException in few destructors of ResultHandler.h (#3311)

kuarora
authored and
facebook-github-bot
committed
Adding test for IndexBinaryFlat.reconstruct_n() (#3310)

kuarora
authored and
facebook-github-bot
committed

Commits on Mar 25, 2024

enable rapidsai-nightly channel for libraft (#3317)

algoriddle
authored and
facebook-github-bot
committed
Fix IVFPQFastScan decode function (#3312)

junjieqi
authored and
facebook-github-bot
committed

Commits on Mar 27, 2024

Change cmake to build googletest from source (#3319)

junjieqi
authored and
facebook-github-bot
committed

Commits on Mar 28, 2024

Fix problems when using 64-bit integers. (#3322)

Chip-Kerchner
authored and
facebook-github-bot
committed

Commits on Mar 29, 2024

Commits on Apr 2, 2024

Fix missing overload variable in Rocksdb ivf demo (#3326)

Warmchay
authored and
facebook-github-bot
committed

Commits on Apr 3, 2024

Support of skip_ids in merge_from_multiple function of OnDiskInvertedLists (#3327)

kuarora
authored and
facebook-github-bot
committed

Commits on Apr 5, 2024

Implement reconstruct_n for GPU IVFFlat indexes (#3338)

junjieqi
authored and
facebook-github-bot
committed
Support for Remove ids from IVFPQFastScan index (#3349)

kuarora
authored and
facebook-github-bot
committed

Commits on Apr 6, 2024

Change index_cpu_to_gpu to throw for indices not implemented on GPU (#3336)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Revert D55723390: Support for Remove ids from IVFPQFastScan index

Gufan Yin
authored and
facebook-github-bot
committed

Commits on Apr 9, 2024

Support for Remove ids from IVFPQFastScan index (#3354)

kuarora
authored and
facebook-github-bot
committed

Commits on Apr 11, 2024

Improve filtering & search parameters propagation (#3304)

alexanderguzhva
authored and
facebook-github-bot
committed
selector parameter for FastScan (#3362)

mdouze
authored and
facebook-github-bot
committed

Commits on Apr 12, 2024

Switch sprintf to snprintf (#3363)

junjieqi
authored and
facebook-github-bot
committed
Remove unused variables in faiss/IndexIVF.cpp

r-barnes
authored and
facebook-github-bot
committed

Commits on Apr 14, 2024

Apply clang-format 18

zertosh
authored and
facebook-github-bot
committed

Commits on Apr 17, 2024

Update required cmake version to 3.24. (#3305)

iotamudelta
authored and
facebook-github-bot
committed

Commits on Apr 19, 2024

Switch clang-format-11 to clang-format-18 (#3372)

junjieqi
authored and
facebook-github-bot
committed

Commits on Apr 22, 2024

remove unused code (#3371)

junjieqi
authored and
facebook-github-bot
committed

Commits on Apr 24, 2024

Unroll loop in lookup_2_lanes (#3364)

Carl Love
authored and
facebook-github-bot
committed
Fix the endianness issue in AIX while running the benchmark. (#3345)

KamathForAIX
authored and
facebook-github-bot
committed
support big-endian machines (#3361)

mdouze
authored and
facebook-github-bot
committed
Few fixes in bench_fw to enable IndexFromCodec (#3383)

kuarora
authored and
facebook-github-bot
committed
Fix IndexBinary.assign Python method

Amir Sadoughi
authored and
facebook-github-bot
committed

Commits on Apr 25, 2024

Fix swig osx (#3357)

junjieqi
authored and
facebook-github-bot
committed

Commits on Apr 26, 2024

fix raft log spew

algoriddle
authored and
facebook-github-bot
committed
Demo on how to address mulitple index contents

mdouze
authored and
facebook-github-bot
committed

Commits on Apr 27, 2024

Fix deprecated use of 0/NULL in faiss/python/python_callbacks.cpp + 1

r-barnes
authored and
facebook-github-bot
committed

Commits on Apr 29, 2024

Initial config and linux-x86_64-cmake build job only

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on Apr 30, 2024

Add linux-x86_64-AVX2-cmake build

ramilbakhshyiev
authored and
facebook-github-bot
committed
Fix #3379: Add tutorial for HNSW index (#3381)

JayjeetAtGithub
authored and
facebook-github-bot
committed
Add format check

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on May 1, 2024

Enable linux-x86_64-conda build via GitHub Actions (#3405)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Enable windows-x86_64-conda build via GitHub Actions (#3406)

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on May 2, 2024

Enable linux-arm64-conda check via GitHub Actions (#3407)

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on May 3, 2024

Commits on May 9, 2024

TimeoutCallback C++ and Python (#3417)

Amir Sadoughi
authored and
facebook-github-bot
committed
Enable linux-x86_64-GPU-w-RAFT-cmake build via GitHub Actions (#3418)

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on May 10, 2024

PowerPC, improve code generation for function fvec_L2sqr (#3416)

Carl Love
authored and
facebook-github-bot
committed

Commits on May 13, 2024

Commits on May 15, 2024

Get rid of redundant instructions in ScalarQuantizer (#3430)

alexanderguzhva
authored and
facebook-github-bot
committed
fix install instructions (#3442)

mdouze
authored and
facebook-github-bot
committed
interrupt for NNDescent (#3432)

Mengdi Lin
authored and
facebook-github-bot
committed
Remove unused variables in faiss/IndexIVFFastScan.cpp (#3439)

r-barnes
authored and
facebook-github-bot
committed
Add cuda-toolkit package dependency to faiss-gpu and faiss-gpu-raft conda build recipes (#3440)

ramilbakhshyiev
authored and
facebook-github-bot
committed
stabilize formatting for bench_cppcontrib_sa_decode.cpp (#3443)

Mengdi Lin
authored and
facebook-github-bot
committed
Enable both RAFT package builds and CUDA 12.1.1 GPU package build (#3441)

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on May 16, 2024

Implement METRIC.NaNEuclidean (#3414)

Amir Sadoughi
authored and
facebook-github-bot
committed
Improve testing code step 1 (#3451)

fxdawnn
authored and
facebook-github-bot
committed

Commits on May 17, 2024

Delete all remaining print (#3452)

fxdawnn
authored and
facebook-github-bot
committed
GitHub Actions files cleanup (#3454)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Cleaning up more unnecessary print (#3455)

fxdawnn
authored and
facebook-github-bot
committed

Commits on May 21, 2024

Properly pass the label for conda upload steps (#3464)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Fix CUDA 11.4.4 builds under CircleCI (#3466)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Enable nightly builds via GitHub Actions (#3467)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Add tutorial for FastScan (#3465)

fxdawnn
authored and
facebook-github-bot
committed
Missed printing 'D' (#3433)

saarthdeshpande
authored and
facebook-github-bot
committed
Add tutorial on PQFastScan for cpp (#3468)

fxdawnn
authored and
facebook-github-bot
committed

Commits on May 22, 2024

Commits on May 23, 2024

QT_bf16 for scalar quantizer for bfloat16 (#3444)

alexanderguzhva
authored and
facebook-github-bot
committed
Add display names to all PR build jobs on GitHub Actions (#3475)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Gate all PR builds behind linux-x86_64-cmake in GitHub Actions (#3476)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Disable CircleCI builds (#3477)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Remove extra semi colon from deprecated/libmccpp/ThreadSafeClientPool.h (#3479)

r-barnes
authored and
facebook-github-bot
committed
Remove duplicate NegativeDistanceComputer instances (#3450)

alexanderguzhva
authored and
facebook-github-bot
committed
Delete Raft Handle (#3435)

tarang-jain
authored and
facebook-github-bot
committed

Commits on May 27, 2024

Add python tutorial on different indexs refinement and respect accuracy measurement (#3480)

fxdawnn
authored and
facebook-github-bot
committed

Commits on May 28, 2024

Workaround for missing intrinsic on gcc < 9 (#3481)

borrrden
authored and
facebook-github-bot
committed
fix algorithm of spreading vectors over shards (#3374)

simshi
authored and
facebook-github-bot
committed

Commits on May 30, 2024

sys.big_endian to sys.byteorder (#3422)

kuarora
authored and
facebook-github-bot
committed

Commits on May 31, 2024

Adding buck target for experiment bench_fw_ivf (#3423)

kuarora
authored and
facebook-github-bot
committed
add skip_storage flag to HNSW (#3487)

mdouze
authored and
facebook-github-bot
committed

Commits on Jun 5, 2024

Add cpp tutorial for index factory refine index construction (#3494)

fxdawnn
authored and
facebook-github-bot
committed
Update .gitignore (#3492)

abhiramvad
authored and
facebook-github-bot
committed

Commits on Jun 11, 2024

Interop between CAGRA and HNSW (#3252)

divyegala
authored and
facebook-github-bot
committed
fix spurious include to land the cagra diff (#3502)

mdouze
authored and
facebook-github-bot
committed

Commits on Jun 13, 2024

add use_raft to knn_gpu (torch) (#3509)

algoriddle
authored and
facebook-github-bot
committed
Add conda bin to path early in the cmake GitHub action (#3512)

ramilbakhshyiev
authored and
facebook-github-bot
committed
typo in test_io_no_storage (#3515)

algoriddle
authored and
facebook-github-bot
committed

Commits on Jun 14, 2024

Consolidate build environment configuration steps in cmake builds (#3516)

ramilbakhshyiev
authored and
facebook-github-bot
committed
fix Windows build - signed int OMP for MSVC (#3517)

algoriddle
authored and
facebook-github-bot
committed

Commits on Jun 17, 2024

Unbreak RAFT conda builds (#3519)

ramilbakhshyiev
authored and
facebook-github-bot
committed

Commits on Jun 18, 2024

Bump libraft to 24.06 to unblock nightly RAFT builds (#3522)

ramilbakhshyiev
authored and
facebook-github-bot
committed
Add ABS_INNER_PRODUCT metric (#3524)

mdouze
authored and
facebook-github-bot
committed