Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Api: Cache embeddings to avoid recreation of it (Step 3) #55

Open
Tracked by #117
ElSalvo96 opened this issue Sep 17, 2023 · 0 comments
Open
Tracked by #117

Api: Cache embeddings to avoid recreation of it (Step 3) #55

ElSalvo96 opened this issue Sep 17, 2023 · 0 comments

Comments

@ElSalvo96
Copy link
Member

ElSalvo96 commented Sep 17, 2023

Read before this: #54

We want to cache the embeddings to avoid the new request to OpenApi.
The idea is:

  • Create a new table with these fields  
       - Hash of text (unique key) SHA-256 
       - Text
       - Embeddings

  • When we save the plugin, we want to split the text with Enter, hash all of that, and search for what sections are not there. 
       - If you found the hash, skip it
       - if you don't find it, call embeddings and save it for the specific hash 

  • Connect this new table with the previous embeddings 

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant