You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[DOC-12715] Document New Search Request Params for Search Fine-Tuning (#291)
* [quickfix]: quickfix: strange font problem on diagram (#274)
Seems to have been caused by extra space in the label.
* [DOC-12610]: Document `nprobe` tweaking
* [DOC=12610]: Moved fine-tuning menu entry.
[DOC=12610]: Moved the stem declaration; wasn't working in the old position.
* [DOC=12610]:
Moved and reworded the sections for clarity.
Adding link to search-index-params.adoc
* [DOC-12715] Add documentation to the JSON search request example and topics around the new added memory-efficient setting and the params object for probe and centroid tuning
* [DOC-12715] Adding on to Ray's documentation to provide a link to Search Request Params.
* [DOC-12715] Comments from peer review
---------
Co-authored-by: Ray Offiah <[email protected]>
Co-authored-by: Ray Offiah <[email protected]>
Copy file name to clipboardExpand all lines: modules/search/pages/search-request-params.adoc
+40Lines changed: 40 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -189,6 +189,12 @@ The Search Service returns the `k` closest vectors to the vector given in `vecto
189
189
190
190
NOTE: The <<size-limit,size or limit property>> overrides any value set in `k`.
191
191
192
+
|params |Object |No a|
193
+
194
+
Enter additional parameters to control how the Search Service compares vectors when running a Vector Search request.
195
+
196
+
For more information about the `params` object, see <<knn-params,>>.
197
+
192
198
|field |String |Yes a|
193
199
194
200
The name of the field that contains the vector data you want to search.
@@ -214,6 +220,40 @@ If the dimensions do not match, your Search query does not return any results.
214
220
For more information about the dimension value, see the xref:search-index-params.adoc#dims[dims property] or the xref:type-mapping-options.adoc#dimension[Dimension option] in the UI.
215
221
|====
216
222
223
+
[#knn-params]
224
+
=== Knn params Object
225
+
226
+
Use the `params` object inside a `knn` object to fine tune the probes and centroids the Search Services uses and searches while running a Vector Search request.
227
+
228
+
The `params` object can contain the following properties:
229
+
230
+
[cols="1,1,1,4"]
231
+
|====
232
+
|Property |Type |Required? |Description
233
+
234
+
|ivf_nprobe_pct |Number (percentage) |No a|
235
+
236
+
Set the `ivf_nprobe_pct` value to control the percentage of probes, or the percentage of clusters, that the Search Service searches during a single Vector Search query.
237
+
238
+
The Search Service automatically calculates a default `nprobe` percentage based on the vectors in a given partition of your Vector Search index.
239
+
For more information about this calculation, see xref:vector-search:fine-tune-vector-search.adoc[].
240
+
241
+
If you set the value of `ivf_nprobe_pct` higher than this default calculated value, the Search Service will search a higher percentage of clusters in your processed vectors.
242
+
This can increase your accuracy and recall for Vector Search, but requires more compute time for each query.
243
+
244
+
In the example, the Search Service searches only `1%` of the total available clusters.
245
+
246
+
|ivf_max_codes_pct |Number (percentage out of 100) |No a|
247
+
248
+
Set the `ivf_max_codes_pct` value to control the maximum number of centroids that the Search Service accesses during a single Vector Search query.
249
+
250
+
By default, this value is always 100%.
251
+
252
+
If you reduce your `ivf_max_codes_pct` value, the Search Service accesses fewer centroids, which reduces your Vector Search accuracy and recall, but gives faster compute times for your search.
253
+
254
+
In the example, the Search Service searches only `0.2%` of the available centroids in your vector data.
Copy file name to clipboardExpand all lines: modules/search/partials/vector-search-field-descriptions.adoc
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
// tag::optimized_for[]
2
-
For a `vector` child field, choose whether the Search Service should prioritize recallor latency when returning similar vectors in search results:
2
+
For a `vector` child field, choose whether the Search Service should prioritize recall, latency, or memory efficiency when returning similar vectors in search results:
3
3
4
4
* *recall*: The Search Service prioritizes returning the most accurate result.
5
5
This may increase resource usage for Search queries.
0 commit comments