Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug: CHUNKS_ENABLED=false has no impact on chunking behavior #446

Closed
fretgfr opened this issue Jul 28, 2023 · 1 comment
Closed

Bug: CHUNKS_ENABLED=false has no impact on chunking behavior #446

fretgfr opened this issue Jul 28, 2023 · 1 comment
Labels
bug Something isn't working

Comments

@fretgfr
Copy link

fretgfr commented Jul 28, 2023

What happened?

CHUNKS_ENABLED=false has no impact on chunking behavior when uploading. Upon finishing, each presumed chunk is it's own incomplete file.

image

Have tested multiple times and this issue is reproducible upon restoring the config to this state.

Have tested on Chrome and Safari

Images relevant to browser logs section:
image
image

Version

latest (ghcr.io/diced/zipline or ghcr.io/diced/zipline:latest)

What browser(s) are you seeing the problem on?

Chromium-based (Chrome, Edge, Brave, Opera, mobile chrome/chromium based, etc)
Safari Desktop

Zipline Logs

Zipline Log Output:

zipline_1   | 2023-07-28 07:42:27,048 AM info  [datasource] using Local(./uploads) datasource
zipline_1   | 2023-07-28 07:42:27,073 AM info  [database::migrations] establishing database connection
zipline_1   | 2023-07-28 07:42:27,073 AM info  [database::migrations] ensuring database exists, if not creating database - may error if no permissions
zipline_1   | 2023-07-28 07:42:27,174 AM info  [database::migrations] exiting migrations engine - database is up to date
zipline_1   | 2023-07-28 07:42:28,314 AM info  [server] listening on 0.0.0.0:3000
zipline_1   | 2023-07-28 07:42:28,314 AM info  [server] started production [email protected] server
zipline_1   | 2023-07-28 07:42:34,260 AM info  [login] User fretgfr (2) logged in
zipline_1   | 2023-07-28 07:42:34,265 AM info  [server::response] POST /api/auth/login -> 200
zipline_1   | 2023-07-28 07:42:34,696 AM info  [server::response] GET /api/user -> 200
zipline_1   | 2023-07-28 07:42:34,782 AM info  [server::response] GET /api/user/folders? -> 200
zipline_1   | 2023-07-28 07:42:34,858 AM info  [server::response] GET /api/user/recent?filter=media -> 200
zipline_1   | 2023-07-28 07:42:34,896 AM info  [server::response] GET /api/user/paged?count=true -> 200
zipline_1   | 2023-07-28 07:42:34,911 AM info  [server::response] GET /api/user/paged?page=1&filter=none&favorite=&sortBy=&order= -> 200
zipline_1   | 2023-07-28 07:42:34,915 AM info  [server::response] GET /api/user/folders? -> 200
zipline_1   | 2023-07-28 07:42:34,965 AM info  [server::response] GET /api/user/files?count=true -> 200
zipline_1   | 2023-07-28 07:42:35,031 AM info  [server::response] GET /api/user/folders? -> 200
zipline_1   | 2023-07-28 07:42:35,043 AM info  [server::response] GET /api/user/paged?page=1&filter=none&favorite=&sortBy=createdAt&order=asc -> 200
zipline_1   | 2023-07-28 07:42:35,096 AM info  [server::response] GET /api/user/folders? -> 200
zipline_1   | 2023-07-28 07:42:41,340 AM info  [server::response] GET /api/user/folders? -> 200
zipline_1   | 2023-07-28 07:42:41,346 AM info  [server::response] GET /api/user/recent?filter=media -> 200
zipline_1   | 2023-07-28 07:42:41,361 AM info  [server::response] GET /api/user/paged?page=1&filter=none&favorite=&sortBy=createdAt&order=asc -> 200
zipline_1   | 2023-07-28 07:42:41,407 AM info  [server::response] GET /api/user/folders? -> 200
zipline_1   | 2023-07-28 07:42:50,644 AM info  [upload] User fretgfr (2) uploaded By5AuT (344512)
zipline_1   | 2023-07-28 07:42:50,645 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:51,605 AM info  [upload] User fretgfr (2) uploaded a81MSI (344513)
zipline_1   | 2023-07-28 07:42:51,605 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:52,532 AM info  [upload] User fretgfr (2) uploaded LdvsPK (344514)
zipline_1   | 2023-07-28 07:42:52,533 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:53,475 AM info  [upload] User fretgfr (2) uploaded u055VR (344515)
zipline_1   | 2023-07-28 07:42:53,476 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:54,394 AM info  [upload] User fretgfr (2) uploaded eoQ3Kk (344516)
zipline_1   | 2023-07-28 07:42:54,395 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:55,297 AM info  [upload] User fretgfr (2) uploaded KQLDBV (344517)
zipline_1   | 2023-07-28 07:42:55,298 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:56,144 AM info  [upload] User fretgfr (2) uploaded yUTQi9 (344518)
zipline_1   | 2023-07-28 07:42:56,144 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:57,352 AM info  [upload] User fretgfr (2) uploaded kupmu7 (344519)
zipline_1   | 2023-07-28 07:42:57,352 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:58,260 AM info  [upload] User fretgfr (2) uploaded vjUyEq (344520)
zipline_1   | 2023-07-28 07:42:58,261 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:42:59,629 AM info  [upload] User fretgfr (2) uploaded j2INGG (344521)
zipline_1   | 2023-07-28 07:42:59,629 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:00,632 AM info  [upload] User fretgfr (2) uploaded HKxBii (344522)
zipline_1   | 2023-07-28 07:43:00,633 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:01,639 AM info  [upload] User fretgfr (2) uploaded RzBspl (344523)
zipline_1   | 2023-07-28 07:43:01,640 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:02,591 AM info  [upload] User fretgfr (2) uploaded ye7wNX (344524)
zipline_1   | 2023-07-28 07:43:02,592 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:03,610 AM info  [upload] User fretgfr (2) uploaded 700UhF (344525)
zipline_1   | 2023-07-28 07:43:03,610 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:04,635 AM info  [upload] User fretgfr (2) uploaded Fa6xOD (344526)
zipline_1   | 2023-07-28 07:43:04,635 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:05,613 AM info  [upload] User fretgfr (2) uploaded 2ONXi1 (344527)
zipline_1   | 2023-07-28 07:43:05,614 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:06,586 AM info  [upload] User fretgfr (2) uploaded KwhGAb (344528)
zipline_1   | 2023-07-28 07:43:06,587 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:07,594 AM info  [upload] User fretgfr (2) uploaded zJHx7Q (344529)
zipline_1   | 2023-07-28 07:43:07,595 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:08,599 AM info  [upload] User fretgfr (2) uploaded STz4MU (344530)
zipline_1   | 2023-07-28 07:43:08,600 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:09,598 AM info  [upload] User fretgfr (2) uploaded g6CJ49 (344531)
zipline_1   | 2023-07-28 07:43:09,598 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:10,588 AM info  [upload] User fretgfr (2) uploaded Ee618J (344532)
zipline_1   | 2023-07-28 07:43:10,589 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:11,578 AM info  [upload] User fretgfr (2) uploaded Q9AXk6 (344533)
zipline_1   | 2023-07-28 07:43:11,579 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:12,568 AM info  [upload] User fretgfr (2) uploaded eQgWy5 (344534)
zipline_1   | 2023-07-28 07:43:12,568 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:13,574 AM info  [upload] User fretgfr (2) uploaded KoZwlt (344535)
zipline_1   | 2023-07-28 07:43:13,575 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:14,563 AM info  [upload] User fretgfr (2) uploaded orHTHN (344536)
zipline_1   | 2023-07-28 07:43:14,564 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:15,593 AM info  [upload] User fretgfr (2) uploaded 97UY1G (344537)
zipline_1   | 2023-07-28 07:43:15,594 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:16,605 AM info  [upload] User fretgfr (2) uploaded Gub8R9 (344538)
zipline_1   | 2023-07-28 07:43:16,606 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:17,594 AM info  [upload] User fretgfr (2) uploaded en4Fqp (344539)
zipline_1   | 2023-07-28 07:43:17,594 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:18,585 AM info  [upload] User fretgfr (2) uploaded DOs0Sx (344540)
zipline_1   | 2023-07-28 07:43:18,585 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:19,596 AM info  [upload] User fretgfr (2) uploaded B5xzZ5 (344541)
zipline_1   | 2023-07-28 07:43:19,596 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:20,579 AM info  [upload] User fretgfr (2) uploaded oDVAp4 (344542)
zipline_1   | 2023-07-28 07:43:20,580 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:21,583 AM info  [upload] User fretgfr (2) uploaded L3OiW0 (344543)
zipline_1   | 2023-07-28 07:43:21,584 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:22,583 AM info  [upload] User fretgfr (2) uploaded 1B2aPm (344544)
zipline_1   | 2023-07-28 07:43:22,584 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:23,725 AM info  [upload] User fretgfr (2) uploaded g60hBD (344545)
zipline_1   | 2023-07-28 07:43:23,726 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:24,584 AM info  [upload] User fretgfr (2) uploaded YDxS0G (344546)
zipline_1   | 2023-07-28 07:43:24,584 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:25,583 AM info  [upload] User fretgfr (2) uploaded A8hNYK (344547)
zipline_1   | 2023-07-28 07:43:25,584 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:26,571 AM info  [upload] User fretgfr (2) uploaded rl00eK (344548)
zipline_1   | 2023-07-28 07:43:26,571 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:27,593 AM info  [upload] User fretgfr (2) uploaded 7WKwiE (344549)
zipline_1   | 2023-07-28 07:43:27,594 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:28,500 AM info  [upload] User fretgfr (2) uploaded cBjMDL (344550)
zipline_1   | 2023-07-28 07:43:28,500 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:29,363 AM info  [upload] User fretgfr (2) uploaded 8aEbnX (344551)
zipline_1   | 2023-07-28 07:43:29,364 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:30,265 AM info  [upload] User fretgfr (2) uploaded 4BAofN (344552)
zipline_1   | 2023-07-28 07:43:30,266 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:31,101 AM info  [upload] User fretgfr (2) uploaded 5d7fkL (344553)
zipline_1   | 2023-07-28 07:43:31,102 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:32,043 AM info  [upload] User fretgfr (2) uploaded kQbOkS (344554)
zipline_1   | 2023-07-28 07:43:32,044 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:32,942 AM info  [upload] User fretgfr (2) uploaded UQC0lf (344555)
zipline_1   | 2023-07-28 07:43:32,942 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:33,778 AM info  [upload] User fretgfr (2) uploaded m80kvk (344556)
zipline_1   | 2023-07-28 07:43:33,779 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:34,622 AM info  [upload] User fretgfr (2) uploaded mEcVqC (344557)
zipline_1   | 2023-07-28 07:43:34,622 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:35,557 AM info  [upload] User fretgfr (2) uploaded p1deIx (344558)
zipline_1   | 2023-07-28 07:43:35,557 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:36,462 AM info  [upload] User fretgfr (2) uploaded U6hffA (344559)
zipline_1   | 2023-07-28 07:43:36,463 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:37,397 AM info  [upload] User fretgfr (2) uploaded YfRgLl (344560)
zipline_1   | 2023-07-28 07:43:37,398 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:38,336 AM info  [upload] User fretgfr (2) uploaded Np1kex (344561)
zipline_1   | 2023-07-28 07:43:38,336 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:39,254 AM info  [upload] User fretgfr (2) uploaded mgXXQp (344562)
zipline_1   | 2023-07-28 07:43:39,254 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:40,629 AM info  [upload] User fretgfr (2) uploaded UKjvSM (344563)
zipline_1   | 2023-07-28 07:43:40,629 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:41,492 AM info  [upload] User fretgfr (2) uploaded 6978UR (344564)
zipline_1   | 2023-07-28 07:43:41,492 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:42,349 AM info  [upload] User fretgfr (2) uploaded x7fBNi (344565)
zipline_1   | 2023-07-28 07:43:42,349 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:43,270 AM info  [upload] User fretgfr (2) uploaded bbY4QN (344566)
zipline_1   | 2023-07-28 07:43:43,271 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:44,202 AM info  [upload] User fretgfr (2) uploaded 27Vov3 (344567)
zipline_1   | 2023-07-28 07:43:44,203 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:45,110 AM info  [upload] User fretgfr (2) uploaded f4FZcy (344568)
zipline_1   | 2023-07-28 07:43:45,111 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:45,930 AM info  [upload] User fretgfr (2) uploaded GYvfOL (344569)
zipline_1   | 2023-07-28 07:43:45,931 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:46,759 AM info  [upload] User fretgfr (2) uploaded XNy70Y (344570)
zipline_1   | 2023-07-28 07:43:46,760 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:47,580 AM info  [upload] User fretgfr (2) uploaded rSNWRz (344571)
zipline_1   | 2023-07-28 07:43:47,581 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:48,401 AM info  [upload] User fretgfr (2) uploaded ZTQbZY (344572)
zipline_1   | 2023-07-28 07:43:48,401 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:49,238 AM info  [upload] User fretgfr (2) uploaded LshJhC (344573)
zipline_1   | 2023-07-28 07:43:49,238 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:50,144 AM info  [upload] User fretgfr (2) uploaded n1VhYU (344574)
zipline_1   | 2023-07-28 07:43:50,144 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:50,989 AM info  [upload] User fretgfr (2) uploaded Rj6tNg (344575)
zipline_1   | 2023-07-28 07:43:50,989 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:51,810 AM info  [upload] User fretgfr (2) uploaded RRBDWi (344576)
zipline_1   | 2023-07-28 07:43:51,811 AM info  [server::response] POST /api/upload -> 200
zipline_1   | 2023-07-28 07:43:52,091 AM info  [upload] User fretgfr (2) uploaded yY9E92 (344577)
zipline_1   | 2023-07-28 07:43:52,092 AM info  [server::response] POST /api/upload -> 200


---------------------------------------------------------------------------------------
---------------------------------------------------------------------------------------

Postgres Log Output (Similar to this but infinitely repeating)

postgres_1  | 2023-07-28 07:45:50.620 UTC [552] WARNING:  database "postgres" has a collation version mismatch
postgres_1  | 2023-07-28 07:45:50.620 UTC [552] DETAIL:  The database was created using collation version 2.31, but the operating system provides version 2.36.
postgres_1  | 2023-07-28 07:45:50.620 UTC [552] HINT:  Rebuild all objects in this database that use the default collation and run ALTER DATABASE postgres REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] WARNING:  database "postgres" has a collation version mismatch
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] DETAIL:  The database was created using collation version 2.31, but the operating system provides version 2.36.
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] HINT:  Rebuild all objects in this database that use the default collation and run ALTER DATABASE postgres REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] CONTEXT:  parallel worker
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] WARNING:  database "postgres" has a collation version mismatch
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] DETAIL:  The database was created using collation version 2.31, but the operating system provides version 2.36.
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] HINT:  Rebuild all objects in this database that use the default collation and run ALTER DATABASE postgres REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.
postgres_1  | 2023-07-28 07:45:50.620 UTC [355] CONTEXT:  parallel worker
postgres_1  | 2023-07-28 07:45:53.008 UTC [560] WARNING:  database "postgres" has a collation version mismatch
postgres_1  | 2023-07-28 07:45:53.008 UTC [560] DETAIL:  The database was created using collation version 2.31, but the operating system provides version 2.36.
postgres_1  | 2023-07-28 07:45:53.008 UTC [560] HINT:  Rebuild all objects in this database that use the default collation and run ALTER DATABASE postgres REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.
postgres_1  | 2023-07-28 07:46:03.100 UTC [568] WARNING:  database "postgres" has a collation version mismatch
postgres_1  | 2023-07-28 07:46:03.100 UTC [568] DETAIL:  The database was created using collation version 2.31, but the operating system provides version 2.36.
postgres_1  | 2023-07-28 07:46:03.100 UTC [568] HINT:  Rebuild all objects in this database that use the default collation and run ALTER DATABASE postgres REFRESH COLLATION VERSION, or build PostgreSQL with the right library version.

Browser Logs

Empty?

Network requests show each item being uploaded. (Image in description section)

Additional Info

version: '3'
services:
  postgres:
    image: postgres:15
    restart: unless-stopped
    environment:
      - POSTGRES_USER=postgres
      - POSTGRES_PASSWORD=postgres
      - POSTGRES_DATABASE=postgres
    volumes:
      - pg_data:/var/lib/postgresql/data
    healthcheck:
      test: ['CMD-SHELL', 'pg_isready -U postgres']
      interval: 10s
      timeout: 5s
      retries: 5

  zipline:
    image: ghcr.io/diced/zipline
    ports:
      - '3000:3000'
    restart: unless-stopped
    environment:
      - CORE_RETURN_HTTPS=true
      - CORE_SECRET=[REDACTED]
      - CORE_HOST=0.0.0.0
      - CORE_PORT=3000
      - CORE_DATABASE_URL=postgres://postgres:postgres@postgres/postgres
      - CORE_LOGGER=true
      - CORE_STATS_INTERVAL=60
      - EXIF_REMOVE_GPS=true
      - FEATURES_INVITES=true
      - RATELIMIT_ADMIN=0
      - RATELIMIT_USER=3
      - CHUNKS_ENABLED=false
      - UPLOADER_ADMIN_LIMIT=1pb
      - UPLOADER_USER_LIMIT=1pb
    volumes:
      - './uploads:/zipline/uploads'
      - '$PWD/public:/zipline/public'
    depends_on:
      - 'postgres'

volumes:
  pg_data:```
@fretgfr fretgfr added the bug Something isn't working label Jul 28, 2023
@github-actions github-actions bot added this to the 3.7.1 milestone Jul 28, 2023
diced added a commit that referenced this issue Jul 28, 2023
@diced
Copy link
Owner

diced commented Jul 28, 2023

Should be fixed b873f99

@diced diced closed this as completed Jul 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants