Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Progressive index import #223

Closed
tchoutri opened this issue Sep 25, 2022 · 0 comments
Closed

Progressive index import #223

tchoutri opened this issue Sep 25, 2022 · 0 comments
Labels
enhancement New feature or request help wanted Help is needed for this ticket

Comments

@tchoutri
Copy link
Contributor

tchoutri commented Sep 25, 2022 •
edited
Loading

At the moment, each index import job tries to import the whole index. This is inefficient, as only the delta between the saved index and the current index could be imported.

We should explore ways to timestamp the files that have been already imported, compute the delta, and feed it to the import job.
@tchoutri tchoutri added enhancement New feature or request help wanted Help is needed for this ticket labels Sep 25, 2022
@tchoutri tchoutri mentioned this issue Oct 4, 2022
Merged
3 tasks
@tchoutri tchoutri pinned this issue Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Help is needed for this ticket
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tchoutri