Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: offloaded chunked uploads #356

Merged
merged 4 commits into from
Apr 4, 2023
Merged

feat: offloaded chunked uploads #356

merged 4 commits into from
Apr 4, 2023

Conversation

diced
Copy link
Owner

@diced diced commented Apr 1, 2023

Uses node workers to offload all chunked uploads into its own "thread". Users can view pending uploads within the files tab, and see their progress.

Very unstable, not tested thoroughly.

@github-actions github-actions bot added this to the 3.7.1 milestone Apr 1, 2023
@diced diced requested review from TacticalTechJay and removed request for TacticalTechJay April 1, 2023 05:25
@diced
Copy link
Owner Author

diced commented Apr 1, 2023

PR needs to update to reflect changes with tmp_directory, etc.

@diced diced linked an issue Apr 1, 2023 that may be closed by this pull request
Copy link
Collaborator

@TacticalTechJay TacticalTechJay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This definitely looks good to me, but it seems as though it would be a tad overkill if a worker was used for smaller byte sized files.

Edit: Double checked. All good 👍

@diced
Copy link
Owner Author

diced commented Apr 3, 2023

This definitely looks good to me, but it seems as though it would be a tad overkill if a worker was used for smaller byte sized files.

Just to dismiss any misunderstandings, the workers are only used for partial uploads.

I will merge this tomorrow with a environment variable that disables chunked uploads entirely for users who do not need it.

@diced diced merged commit eedeb89 into trunk Apr 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Bug: Files over 500mb kills upload
2 participants