Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Recycle old download files when available #947

Open
lukavdplas opened this issue Nov 16, 2022 · 0 comments
Open

Recycle old download files when available #947

lukavdplas opened this issue Nov 16, 2022 · 0 comments
Labels
backend changes to the django backend enhancement improvements to user functionality

Comments

@lukavdplas
Copy link
Contributor

The download log stores the parameters and filename of each request, so it can be used as a caching system.

Roughly speaking, if there is a download in the database with the same corpus + parameters as a new request, you can just log the same filename and skip generating a new file.

It would be good to also build in some expiration date, e.g. only do this if the original download was started within the last n days. While the old file can remain available to the user that requested it originally, new users should not receive possible outdated data. (Due to updates or the like.)

@lukavdplas lukavdplas added enhancement improvements to user functionality backend changes to the django backend labels Nov 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend changes to the django backend enhancement improvements to user functionality
Projects
None yet
Development

No branches or pull requests

1 participant