sqlite3.OperationalError: no such table: file_info_cbz #110

vonProteus · 2024-06-05T04:22:40Z

What happened ?

i get exeption

What did you expect to happen ?

download as usual

OS version

docker image python:3

App version

mangadex-downloader v2.10.3 (https://github.com/mansuf/mangadex-downloader)
Python: 3.12.3
arch: x64
bundled executable: no

Installation origin

Other

Installation origin (other sources)

ae3ab36

Reproducible command

mangadex-downloader --language en --sort-by chapter --save-as "cbz" --delay-requests 1.5 /downloads/download.txt

Additional context

after i checkout to v3.0.0
and i run mangadex-downloader --language en --sort-by chapter --save-as "cbz" --delay-requests 1.5 /downloads/download.txt
i get

[INFO] Checking url = https://mangadex.org/title/#MANGA_URL#
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/#MANGA#"
[INFO] Using cbz format
[INFO] Downloading cover manga #MANGA#
File sizes: 100%|████████████████████████████| 485k/485k [00:00<00:00, 16.1MB/s]
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/__init__.py", line 87, in _main
    download(args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/download.py", line 34, in download
    url(args, args.type)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/url.py", line 187, in __call__
    self.func(self.id, args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/url.py", line 105, in download_manga
    dl_manga(*args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/main.py", line 200, in download
    download_manga(manga, formatted_path)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/main.py", line 136, in download_manga
    m.tracker = get_tracker(save_as, path)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/__init__.py", line 162, in get_tracker
    return DownloadTrackerSQLite(fmt, path)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sqlite.py", line 81, in __init__
    self.init_write_mode()
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sqlite.py", line 99, in init_write_mode
    self._load()
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sqlite.py", line 388, in _load
    sql_migrate(self.db)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sql_migrations/__init__.py", line 33, in migrate
    migrate_cls.migrate()
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py", line 117, in migrate
    volume_values = self._get_values_for_volume_column()
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py", line 34, in _get_values_for_volume_column
    fi_cursor.execute(f"SELECT * FROM file_info_{self.get_format()}")
sqlite3.OperationalError: no such table: file_info_cbz

i don't think it is connected to #108 but i was testing it

i had to set env MANGADEXDL_CONFIG_ENABLED=1
before that i got

[INFO] Checking url = https://mangadex.org/title/#MANGA#
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/#MANGA#"
[ERROR] Config is not enabled. You can enable it by set MANGADEXDL_CONFIG_ENABLED to 1
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/download.py", line 34, in download
    url(args, args.type)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/url.py", line 187, in __call__
    self.func(self.id, args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/url.py", line 105, in download_manga
    dl_manga(*args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/main.py", line 200, in download
    download_manga(manga, formatted_path)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/main.py", line 101, in download_manga
    config.save_as = backup_fmt
    ^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/config/config.py", line 308, in __setattr__
    _conf.write(name, val)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/config/config.py", line 235, in write
    raise MangaDexException(
mangadex_downloader.errors.MangaDexException: Config is not enabled. You can enable it by set MANGADEXDL_CONFIG_ENABLED to 1
[INFO] Cleaning up...

here is docker file i run
https://github.com/vonProteus/mangadex-downloader-docker/tree/tmp-3.0.0

The text was updated successfully, but these errors were encountered:

mansuf · 2024-06-05T04:51:03Z

About the error

sqlite3.OperationalError: no such table: file_info_cbz

You solved it by enabling env MANGADEXDL_CONFIG_ENABLED=1 ?

As far as i know, i implemented migrations to database, and it should works for the first time

vonProteus · 2024-06-05T04:55:18Z

no
first i get error you have to set env
after setting it
i get SQLite error
i tried it on new manga and existing same result

mansuf · 2024-06-05T05:03:53Z

Can you send me download.db file from the download directory ? I wanna inspect it, because in my end it works fine. I hope it's just permission error that the database cannot write it like this one #52

mansuf · 2024-06-05T05:07:17Z

For now, you might wanna disable download tracking by enabling --no-track option, it will continue download as usual but you won't find download.db file. By enabling --no-track option, the app cannot check the latest chapters.

vonProteus · 2024-06-05T05:13:16Z

download.db.zip
from new manga
with 3.0.0
looks empty to me

mansuf · 2024-06-05T05:55:22Z

Looking up your download.db it seems the migration file 00000_init.py hasn't applied correctly, you can try see it by setting --log-level=DEBUG when downloading manga.

Output

sussyuser@SUSSY-PC:~/md-test$ docker run mangadex-dl:v3.0.0 "tamamo no koi" -s --input-pos 1 -f cbz --verbose
[WARNING] --verbose is deprecated and will be removed in v3.0.0. Use '--log-level=DEBUG' instead
[DEBUG] Config 'stacked_progress_bar_order' (value: ['volumes', 'chapters', 'pages', 'file sizes', 'convert']) is not passed validator test, reason: 'list' object has no attribute 'split'. Falling back to default value
[DEBUG] Loaded config from cli args = {'login_cache': False, 'language': 'en', 'cover': 'original', 'save_as': 'cbz', 'use_chapter_title': False, 'use_compressed_image': False, 'force_https': False, 'path': './{manga.title}', 'filename_chapter': '{chapter.simple_name}{file_ext}', 'filename_volume': 'Vol. {volume}{file_ext}', 'filename_single': 'All chapters{file_ext}', 'dns_over_https': None, 'no_group_name': False, 'sort_by': 'volume', 'no_progress_bar': False, 'http_retries': 5, 'write_tachiyomi_info': False, 'download_mode': 'default', 'use_chapter_cover': False, 'use_volume_cover': False, 'no_track': False, 'volume_cover_language': None, 'stacked_progress_bar_order': 'volumes, chapters, pages, file sizes, convert', 'log_level': 'DEBUG', 'progress_bar_layout': 'default', 'ignore_missing_chapters': False, 'create_no_volume': False, 'create_manga_info': False, 'manga_info_format': 'csv', 'manga_info_filepath': '{download_path}/manga_info.{manga_info_format}'}
[INFO] Checking url = 433e77d2-5a58-48a3-95b8-e3c02f309255
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/Tamamo no Koi"
[INFO] Using cbz format
[INFO] Downloading cover manga Tamamo no Koi
File sizes: 100%|████████████████████████████| 260k/260k [00:00<00:00, 21.1MB/s]
[DEBUG] Applying download tracker database migration 00000_init.py...
[DEBUG] Applying download tracker database migration 00001_add_table_db_info_and_alter_table_file_info.py...
[INFO] Preparing to download...
[INFO] Getting images from chapter 0
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 1
File sizes: 100%|████████████████████████████| 695k/695k [00:00<00:00, 5.33MB/s]
[DEBUG] Reporting {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/2cb2a15b58b96bc72b705849ce15ed8b/1-42b91b72bbce2b2f62c24c4c4d56a84d79bc6952139e19924a7a6acc72ed13eb.png', 'success': True, 'cached': False, 'bytes': 694683, 'duration': 425} to MangaDex network
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 2

I tried installing your docker image to my server and test it and it works without errors.

mansuf · 2024-06-05T05:57:17Z

Maybe you can try these python script to test it out if migration is really works. Make sure to test it in your docker container.

import sqlite3
from mangadex_downloader.tracker.sql_migrations import _iter_migrate_cls
from mangadex_downloader.tracker.sql_migrations.base import SQLMigration
from mangadex_downloader.tracker.sqlite import DownloadTrackerSQLite
from pathlib import Path

db_path = DownloadTrackerSQLite.get_tracker_path("cbz", Path("./Tamamo no Koi"))
db = sqlite3.connect(db_path)

cls: SQLMigration
for cls, file in _iter_migrate_cls():
    if file != "00000_init.py":
        continue

    print(cls.check_if_migrate_is_possible())
    cls.migrate()

vonProteus · 2024-06-05T13:35:19Z

first i build
docker build --progress=plain -t mangadex-downloader .
from vonProteus/mangadex-downloader-docker@43ca28c
and when i run
docker run -ti -v ./downloads:/downloads/ --rm mangadex-downloader "tamamo no koi" -s --input-pos 1 -f cbz --log-level=DEBUG
i get

[DEBUG] Config 'stacked_progress_bar_order' (value: ['volumes', 'chapters', 'pages', 'file sizes', 'convert']) is not passed validator test, reason: 'list' object has no attribute 'split'. Falling back to default value
[DEBUG] Loaded config from cli args = {'login_cache': False, 'language': 'en', 'cover': 'original', 'save_as': 'cbz', 'use_chapter_title': False, 'use_compressed_image': False, 'force_https': False, 'path': './{manga.title}', 'filename_chapter': '{chapter.simple_name}{file_ext}', 'filename_volume': 'Vol. {volume}{file_ext}', 'filename_single': 'All chapters{file_ext}', 'dns_over_https': None, 'no_group_name': False, 'sort_by': 'volume', 'no_progress_bar': False, 'http_retries': 5, 'write_tachiyomi_info': False, 'download_mode': 'default', 'use_chapter_cover': False, 'use_volume_cover': False, 'no_track': False, 'volume_cover_language': None, 'stacked_progress_bar_order': 'volumes, chapters, pages, file sizes, convert', 'log_level': 'DEBUG', 'progress_bar_layout': 'default', 'ignore_missing_chapters': False, 'create_no_volume': False, 'create_manga_info': False, 'manga_info_format': 'csv', 'manga_info_filepath': '{download_path}/manga_info.{manga_info_format}'}
[INFO] Checking url = 433e77d2-5a58-48a3-95b8-e3c02f309255
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/Tamamo no Koi"
[INFO] Using cbz format
[INFO] Downloading cover manga Tamamo no Koi
[INFO] File exist and replace is False, cancelling download...
[DEBUG] Applying download tracker database migration 00001_add_table_db_info_and_alter_table_file_info.py...
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/__init__.py", line 87, in _main
    download(args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/download.py", line 34, in download
    url(args, args.type)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/url.py", line 187, in __call__
    self.func(self.id, args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/cli/url.py", line 105, in download_manga
    dl_manga(*args)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/main.py", line 200, in download
    download_manga(manga, formatted_path)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/main.py", line 136, in download_manga
    m.tracker = get_tracker(save_as, path)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/__init__.py", line 162, in get_tracker
    return DownloadTrackerSQLite(fmt, path)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sqlite.py", line 81, in __init__
    self.init_write_mode()
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sqlite.py", line 99, in init_write_mode
    self._load()
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sqlite.py", line 388, in _load
    sql_migrate(self.db)
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sql_migrations/__init__.py", line 33, in migrate
    migrate_cls.migrate()
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py", line 117, in migrate
    volume_values = self._get_values_for_volume_column()
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py", line 34, in _get_values_for_volume_column
    fi_cursor.execute(f"SELECT * FROM file_info_{self.get_format()}")
sqlite3.OperationalError: no such table: file_info_cbz

and in ./downloads
Tamamo no Koi.zip

mansuf · 2024-06-05T13:46:07Z

[DEBUG] Applying download tracker database migration 00001_add_table_db_info_and_alter_table_file_info.py...

See, before this line of output, you should see:

[DEBUG] Applying download tracker database migration 00000_init.py...

And from your output, the 00000_init.py file is missing. You should check migration files under mangadex_downloader/tracker/sql_migrations directory

vonProteus · 2024-06-05T14:37:45Z

i think its related to v3 somehow and my not perfect docker image
i will wait for you image

vonProteus · 2024-06-05T16:02:54Z

in my image v3

root@077fe700dbb5:/downloads# ls -lah "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sql_migrations/"
total 32K
drwxr-xr-x 3 root root 4.0K Jun  5 15:57 .
drwxr-xr-x 6 root root 4.0K Jun  5 15:57 ..
-rw-r--r-- 1 root root 1.5K Jun  5 15:57 00000_init.py
-rw-r--r-- 1 root root 5.0K Jun  5 15:57 00001_add_table_db_info_and_alter_table_file_info.py
-rw-r--r-- 1 root root  936 Jun  5 15:57 __init__.py
drwxr-xr-x 2 root root 4.0K Jun  5 15:57 __pycache__
-rw-r--r-- 1 root root 3.6K Jun  5 15:57 base.py

mansuf · 2024-06-06T05:25:17Z

this whole bug is about version 3

I'm really sorry i didn't notice that.

From your output checking sql_migrations directory #110 (comment), you have the 00000_init.py file and yet the migration is not applied tho, why ? I'm really confused

mansuf · 2024-06-06T05:30:59Z

Can you help me add these script #110 (comment) and run it in your docker image ?

I really wanna make sure what is wrong with the migration

You can use same command to download test manga from here #110 (comment) and then run the script

docker run -ti -v ./downloads:/downloads/ --rm mangadex-downloader "tamamo no koi" -s --input-pos 1 -f cbz --log-level=DEBUG

# And then run the migration script

vonProteus · 2024-06-06T14:30:04Z

in container from 3.0.0 branch
mangadex-downloader "tamamo no koi" -s --input-pos 1 -f cbz --log-level=DEBUG

[DEBUG] Config 'stacked_progress_bar_order' (value: ['volumes', 'chapters', 'pages', 'file sizes', 'convert']) is not passed validator test, reason: 'list' object has no attribute 'split'. Falling back to default value
[DEBUG] Loaded config from cli args = {'login_cache': False, 'language': 'en', 'cover': 'original', 'save_as': 'cbz', 'use_chapter_title': False, 'use_compressed_image': False, 'force_https': False, 'path': './{manga.title}', 'filename_chapter': '{chapter.simple_name}{file_ext}', 'filename_volume': 'Vol. {volume}{file_ext}', 'filename_single': 'All chapters{file_ext}', 'dns_over_https': None, 'no_group_name': False, 'sort_by': 'volume', 'no_progress_bar': False, 'http_retries': 5, 'write_tachiyomi_info': False, 'download_mode': 'default', 'use_chapter_cover': False, 'use_volume_cover': False, 'no_track': False, 'volume_cover_language': None, 'stacked_progress_bar_order': 'volumes, chapters, pages, file sizes, convert', 'log_level': 'DEBUG', 'progress_bar_layout': 'default', 'ignore_missing_chapters': False, 'create_no_volume': False, 'create_manga_info': False, 'manga_info_format': 'csv', 'manga_info_filepath': '{download_path}/manga_info.{manga_info_format}'}
[INFO] Checking url = 433e77d2-5a58-48a3-95b8-e3c02f309255
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/Tamamo no Koi"
[INFO] Using cbz format
[INFO] Downloading cover manga Tamamo no Koi
File sizes: 100%|████████████████████████████| 260k/260k [00:00<00:00, 2.37MB/s]
[DEBUG] Applying download tracker database migration 00001_add_table_db_info_and_alter_table_file_info.py...
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/cli/__init__.py", line 87, in _main
    download(args)
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/cli/download.py", line 34, in download
    url(args, args.type)
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/cli/url.py", line 187, in __call__
    self.func(self.id, args)
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/cli/url.py", line 105, in download_manga
    dl_manga(*args)
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/main.py", line 200, in download
    download_manga(manga, formatted_path)
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/main.py", line 136, in download_manga
    m.tracker = get_tracker(save_as, path)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/__init__.py", line 162, in get_tracker
    return DownloadTrackerSQLite(fmt, path)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sqlite.py", line 81, in __init__
    self.init_write_mode()
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sqlite.py", line 99, in init_write_mode
    self._load()
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sqlite.py", line 388, in _load
    sql_migrate(self.db)
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sql_migrations/__init__.py", line 33, in migrate
    migrate_cls.migrate()
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py", line 117, in migrate
    volume_values = self._get_values_for_volume_column()
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py", line 34, in _get_values_for_volume_column
    fi_cursor.execute(f"SELECT * FROM file_info_{self.get_format()}")
sqlite3.OperationalError: no such table: file_info_cbz

cat script.py

import sqlite3
from mangadex_downloader.tracker.sql_migrations import _iter_migrate_cls
from mangadex_downloader.tracker.sql_migrations.base import SQLMigration
from mangadex_downloader.tracker.sqlite import DownloadTrackerSQLite

db_path = DownloadTrackerSQLite.get_tracker_path("cbz", "./Tamamo no Koi")
db = sqlite3.connect(db_path)

cls: SQLMigration
for cls, file in _iter_migrate_cls():
    if file != "00000_init.py":
        continue

    print(cls.check_if_migrate_is_possible())
    cls.migrate()

tree

.
├── Tamamo no Koi
│   ├── cover.jpg
│   └── download.db
└── script.py

2 directories, 3 files

python script.py

Traceback (most recent call last):
  File "/downloads/script.py", line 6, in <module>
    db_path = DownloadTrackerSQLite.get_tracker_path("cbz", "./Tamamo no Koi")
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sqlite.py", line 147, in get_tracker_path
    return path / "download.db"
           ~~~~~^~~~~~~~~~~~~~~
TypeError: unsupported operand type(s) for /: 'str' and 'str'

vonProteus · 2024-06-06T14:46:31Z

after changing
/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sqlite.py 147
to
return path + "/download.db"
and changing script to

import sqlite3
from mangadex_downloader.tracker.sql_migrations import _iter_migrate_cls
from mangadex_downloader.tracker.sql_migrations.base import SQLMigration
from mangadex_downloader.tracker.sqlite import DownloadTrackerSQLite

db_path = DownloadTrackerSQLite.get_tracker_path("cbz", "./Tamamo no Koi")
db = sqlite3.connect(db_path)

cls: SQLMigration
for cls, file in _iter_migrate_cls(db):
    if file != "00000_init.py":
        continue

    print(cls.check_if_migrate_is_possible())
    cls.migrate()

first run is True second is False

mansuf · 2024-06-06T15:20:39Z

after changing
/usr/local/lib/python3.11/site-packages/mangadex_downloader/tracker/sqlite.py 147
to
return path + "/download.db"
and changing script to

Sorry i was forgot to fix that, it was actually

from pathlib import Path
db_path = DownloadTrackerSQLite.get_tracker_path("cbz", Path("./Tamamo no Koi"))

first run is True second is False

Huh, if the first run is True and and the second one is False then the migration is success. Is the database file (download.db) size is increased after that ?

vonProteus · 2024-06-06T15:45:35Z

root@77078be60e1c:/downloads# ls -alh Tamamo\ no\ Koi/
total 272K
drwxr-xr-x 2 root root 4.0K Jun  6 15:43 .
drwxr-xr-x 1 root root 4.0K Jun  6 15:43 ..
-rw-r--r-- 1 root root 255K Jun  6 15:43 cover.jpg
-rw-r--r-- 1 root root 8.0K Jun  6 15:43 download.db
root@77078be60e1c:/downloads# python script.py
True
root@77078be60e1c:/downloads# ls -alh Tamamo\ no\ Koi/
total 284K
drwxr-xr-x 2 root root 4.0K Jun  6 15:44 .
drwxr-xr-x 1 root root 4.0K Jun  6 15:44 ..
-rw-r--r-- 1 root root 255K Jun  6 15:43 cover.jpg
-rw-r--r-- 1 root root  20K Jun  6 15:44 download.db

mansuf · 2024-06-06T16:09:05Z

Okay, so the download.db size is increased and the migration is success. And why the heck it's not working if the app is running normally ?

I don't know man, i'm really confused right now. Either the application has a bug that only you can reproduce it or something going on with the docker image or permissions files. You have to fix it yourself, i'm really sorry i cannot provide solution any further.

If you found a fix for the bug you can tell me and i will create documentaion of how to fix this issue or patch to v3.0.0 branch.

For now you might want to apply 00000_init.py migration manually from script that i give to you #110 (comment).

vonProteus · 2024-06-08T11:08:42Z

i don't know why but when i do this

diff --git a/mangadex_downloader/tracker/sql_migrations/00000_init.py b/mangadex_downloader/tracker/sql_migrations/00001_init.py
rename from mangadex_downloader/tracker/sql_migrations/00000_init.py
rename to mangadex_downloader/tracker/sql_migrations/00001_init.py
diff --git a/mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py b/mangadex_downloader/tracker/sql_migrations/00002_add_table_db_info_and_alter_table_file_info.py
rename from mangadex_downloader/tracker/sql_migrations/00001_add_table_db_info_and_alter_table_file_info.py
rename to mangadex_downloader/tracker/sql_migrations/00002_add_table_db_info_and_alter_table_file_info.py

this seems to solve the problem

mansuf · 2024-06-13T08:03:58Z

i don't know why but when i do this

Hmmmm, interesting. It's really works just like that ? I have created that patch ffd2f24, if you can test it, it could be useful

vonProteus · 2024-06-13T14:34:23Z

first run from ffd2f24

time (nocorrect docker build --progress=plain -t mangadex-downloader . && docker run -ti -v ./downloads:/downloads/ --rm mangadex-downloader "tamamo no koi" -s --input-pos 1 -f cbz --log-level=DEBUG )

DEBUG] Config 'stacked_progress_bar_order' (value: ['volumes', 'chapters', 'pages', 'file sizes', 'convert']) is not passed validator test, reason: 'list' object has no attribute 'split'. Falling back to default value
[DEBUG] Loaded config from cli args = {'login_cache': False, 'language': 'en', 'cover': 'original', 'save_as': 'cbz', 'use_chapter_title': False, 'use_compressed_image': False, 'force_https': False, 'path': './{manga.title}', 'filename_chapter': '{chapter.simple_name}{file_ext}', 'filename_volume': 'Vol. {volume}{file_ext}', 'filename_single': 'All chapters{file_ext}', 'dns_over_https': None, 'no_group_name': False, 'sort_by': 'volume', 'no_progress_bar': False, 'http_retries': 5, 'write_tachiyomi_info': False, 'download_mode': 'default', 'use_chapter_cover': False, 'use_volume_cover': False, 'no_track': False, 'volume_cover_language': None, 'stacked_progress_bar_order': 'volumes, chapters, pages, file sizes, convert', 'log_level': 'DEBUG', 'progress_bar_layout': 'default', 'ignore_missing_chapters': False, 'create_no_volume': False, 'create_manga_info': False, 'manga_info_format': 'csv', 'manga_info_filepath': '{download_path}/manga_info.{manga_info_format}'}
[INFO] Checking url = 433e77d2-5a58-48a3-95b8-e3c02f309255
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/Tamamo no Koi"
[INFO] Using cbz format
[INFO] Downloading cover manga Tamamo no Koi
File sizes: 100%|████████████████████████████| 260k/260k [00:00<00:00, 1.82MB/s]
[DEBUG] Applying download tracker database migration 00001_init.py...
[DEBUG] Applying download tracker database migration 00002_add_table_db_info_and_alter_table_file_info.py...
[INFO] Preparing to download...
[INFO] Getting images from chapter 0
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 1
File sizes: 100%|█████████████████████████████| 695k/695k [00:00<00:00, 843kB/s]
[DEBUG] Reporting {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/2cb2a15b58b96bc72b705849ce15ed8b/1-42b91b72bbce2b2f62c24c4c4d56a84d79bc6952139e19924a7a6acc72ed13eb.png', 'success': True, 'cached': False, 'bytes': 694683, 'duration': 1277} to MangaDex network
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 2
File sizes: 100%|████████████████████████████| 536k/536k [00:00<00:00, 3.38MB/s]
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 3
File sizes: 100%|████████████████████████████| 491k/491k [00:00<00:00, 3.69MB/s]
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 4
File sizes: 100%|████████████████████████████| 457k/457k [00:00<00:00, 3.61MB/s]
[INFO] Downloading [AteTeenPlus & AfterLife Scans] Chapter. 0 Oneshot page 5
[DEBUG] Successfully send report {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/2cb2a15b58b96bc72b705849ce15ed8b/1-42b91b72bbce2b2f62c24c4c4d56a84d79bc6952139e19924a7a6acc72ed13eb.png', 'success': True, 'cached': False, 'bytes': 694683, 'duration': 1277} to MangaDex network
[DEBUG] Reporting {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/2cb2a15b58b96bc72b705849ce15ed8b/2-b6531c9af440614fcb55854eeef444f53956b7df7ca87d6e691f8d347a399826.png', 'success': True, 'cached': False, 'bytes': 535864, 'duration': 204} to MangaDex network
…
[INFO] Downloading [No Group Scanlation] Volume. 1 Chapter. 6 page 31
[DEBUG] Successfully send report {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/a146b42e90bda4200e616215027ba343/30-9a0448957fadd95d73c962e5cac07a5da12ea6f68990631845f74e5243b7e3c2.jpg', 'success': True, 'cached': False, 'bytes': 355792, 'duration': 1634} to MangaDex network
File sizes: 100%|█████████████████████████████| 351k/351k [00:00<00:00, 412kB/s]
[DEBUG] Reporting {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/a146b42e90bda4200e616215027ba343/31-56bf4d39c94e1dd222849bbf6c98065a7afb758214a12bbc8679ffe12a80fccf.jpg', 'success': True, 'cached': False, 'bytes': 350860, 'duration': 2005} to MangaDex network
[INFO] Downloading [No Group Scanlation] Volume. 1 Chapter. 6 page 32
[DEBUG] Successfully send report {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/a146b42e90bda4200e616215027ba343/31-56bf4d39c94e1dd222849bbf6c98065a7afb758214a12bbc8679ffe12a80fccf.jpg', 'success': True, 'cached': False, 'bytes': 350860, 'duration': 2005} to MangaDex network
File sizes: 100%|█████████████████████████████| 221k/221k [00:00<00:00, 933kB/s]
[DEBUG] Reporting {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/a146b42e90bda4200e616215027ba343/32-d337c78d7b14f9c4f3f38968cef2b57e0b719865d59be8657beb0f18549f4195.png', 'success': True, 'cached': False, 'bytes': 221338, 'duration': 1443} to MangaDex network
[INFO] [No Group Scanlation] Vol. 1 Ch. 6 has finished download, converting to .cbz file...
Convert: 100%|██████████████████████████████| 32.0/32.0 [00:00<00:00, 128page/s]
[INFO] Waiting for chapter read marker to finish
[INFO] Download finished for manga "Tamamo no Koi"
[DEBUG] Checking update...
[DEBUG] Successfully send report {'url': 'https://cmdxd98sb0x3yprd.mangadex.network/data/a146b42e90bda4200e616215027ba343/32-d337c78d7b14f9c4f3f38968cef2b57e0b719865d59be8657beb0f18549f4195.png', 'success': True, 'cached': False, 'bytes': 221338, 'duration': 1443} to MangaDex network
[DEBUG] No update found
[INFO] Cleaning up...
[DEBUG] Closing network object

and second try

[DEBUG] Config 'stacked_progress_bar_order' (value: ['volumes', 'chapters', 'pages', 'file sizes', 'convert']) is not passed validator test, reason: 'list' object has no attribute 'split'. Falling back to default value
[DEBUG] Loaded config from cli args = {'login_cache': False, 'language': 'en', 'cover': 'original', 'save_as': 'cbz', 'use_chapter_title': False, 'use_compressed_image': False, 'force_https': False, 'path': './{manga.title}', 'filename_chapter': '{chapter.simple_name}{file_ext}', 'filename_volume': 'Vol. {volume}{file_ext}', 'filename_single': 'All chapters{file_ext}', 'dns_over_https': None, 'no_group_name': False, 'sort_by': 'volume', 'no_progress_bar': False, 'http_retries': 5, 'write_tachiyomi_info': False, 'download_mode': 'default', 'use_chapter_cover': False, 'use_volume_cover': False, 'no_track': False, 'volume_cover_language': None, 'stacked_progress_bar_order': 'volumes, chapters, pages, file sizes, convert', 'log_level': 'DEBUG', 'progress_bar_layout': 'default', 'ignore_missing_chapters': False, 'create_no_volume': False, 'create_manga_info': False, 'manga_info_format': 'csv', 'manga_info_filepath': '{download_path}/manga_info.{manga_info_format}'}
[INFO] Checking url = 433e77d2-5a58-48a3-95b8-e3c02f309255
[INFO] Using English language
[INFO] Fetching all chapters...
[INFO] Download directory is set to "/downloads/Tamamo no Koi"
[INFO] Using cbz format
[INFO] Downloading cover manga Tamamo no Koi
[INFO] File exist and replace is False, cancelling download...
[DEBUG] Applying download tracker database migration 00002_add_table_db_info_and_alter_table_file_info.py...
[INFO] Preparing to download...
[INFO] Verifying downloaded chapters...
[INFO] 'Ch. 0 Oneshot.cbz' is verified and no need to re-download
[INFO] 'Vol. 1 Ch. 1.cbz' is verified and no need to re-download
[INFO] 'Vol. 1 Ch. 2.cbz' is verified and no need to re-download
[INFO] 'Vol. 1 Ch. 3.cbz' is verified and no need to re-download
[INFO] 'Vol. 1 Ch. 4.cbz' is verified and no need to re-download
[INFO] 'Vol. 1 Ch. 5.cbz' is verified and no need to re-download
[INFO] 'Vol. 1 Ch. 6.cbz' is verified and no need to re-download
[INFO] Waiting for chapter read marker to finish
[INFO] Download finished for manga "Tamamo no Koi"
[DEBUG] Checking update...
[DEBUG] No update found
[INFO] Cleaning up...
[DEBUG] Closing network object

so everything looks fixed now

mansuf · 2024-06-14T02:23:40Z

A simple rename files is key to fixing bugs, yeah.

Anyway, thank you for your contribution from testing, reporting bugs and everything !

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

sqlite3.OperationalError: no such table: file_info_cbz #110

sqlite3.OperationalError: no such table: file_info_cbz #110

vonProteus commented Jun 5, 2024 •

edited

Loading

mansuf commented Jun 5, 2024 •

edited

Loading

vonProteus commented Jun 5, 2024

mansuf commented Jun 5, 2024

mansuf commented Jun 5, 2024

vonProteus commented Jun 5, 2024

mansuf commented Jun 5, 2024

mansuf commented Jun 5, 2024 •

edited

Loading

vonProteus commented Jun 5, 2024

mansuf commented Jun 5, 2024

vonProteus commented Jun 5, 2024

vonProteus commented Jun 5, 2024

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as off-topic.

mansuf commented Jun 6, 2024 •

edited

Loading

mansuf commented Jun 6, 2024 •

edited

Loading

vonProteus commented Jun 6, 2024

vonProteus commented Jun 6, 2024

mansuf commented Jun 6, 2024

vonProteus commented Jun 6, 2024

mansuf commented Jun 6, 2024

vonProteus commented Jun 8, 2024

mansuf commented Jun 13, 2024

vonProteus commented Jun 13, 2024

mansuf commented Jun 14, 2024

sqlite3.OperationalError: no such table: file_info_cbz #110

sqlite3.OperationalError: no such table: file_info_cbz #110

Comments

vonProteus commented Jun 5, 2024 • edited Loading

What happened ?

What did you expect to happen ?

OS version

App version

Installation origin

Installation origin (other sources)

Reproducible command

Additional context

mansuf commented Jun 5, 2024 • edited Loading

vonProteus commented Jun 5, 2024

mansuf commented Jun 5, 2024

mansuf commented Jun 5, 2024

vonProteus commented Jun 5, 2024

mansuf commented Jun 5, 2024

mansuf commented Jun 5, 2024 • edited Loading

vonProteus commented Jun 5, 2024

mansuf commented Jun 5, 2024

vonProteus commented Jun 5, 2024

vonProteus commented Jun 5, 2024

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as off-topic.

mansuf commented Jun 6, 2024 • edited Loading

mansuf commented Jun 6, 2024 • edited Loading

vonProteus commented Jun 6, 2024

vonProteus commented Jun 6, 2024

mansuf commented Jun 6, 2024

vonProteus commented Jun 6, 2024

mansuf commented Jun 6, 2024

vonProteus commented Jun 8, 2024

mansuf commented Jun 13, 2024

vonProteus commented Jun 13, 2024

mansuf commented Jun 14, 2024

vonProteus commented Jun 5, 2024 •

edited

Loading

mansuf commented Jun 5, 2024 •

edited

Loading

mansuf commented Jun 5, 2024 •

edited

Loading

mansuf commented Jun 6, 2024 •

edited

Loading

mansuf commented Jun 6, 2024 •

edited

Loading