Checking all media stalled

[mikeyounge]

I haven’t had a new download start or finish processing in the last 3+ days because the “Checking All Media From Source” task is running on one item too long. I reset tasks this morning to see if there was an issue and it has processed two channels so far. I have successfully managed 30+ channels so far with thousands of videos between them. This only started this week since updating. I do not recall what the previous update was, but I try to update weekly. So something changed in the last 10 days or so to cause this. I cannot provide any relevant logs because they are only showing Django interactions. The webUI is responsive and seems to be fine. If there is a debug mode, I’ll activate it and provide any relevant logs.

It started at 9AM this morning and processed the first channel twice over until 10:15. The second channel started processing and ran the task 4 times over 10 hours. The third channel is on the first pass and has been running for 2 hours so far. Any help would be appreciated. Thanks.

[tcely]

(Continued from #817)

Which database are you using?

If there is a debug mode, I’ll activate it and provide any relevant logs.

There is a TUBESYNC_DEBUG environment variable you can set for much more logging.

[mikeyounge]

I’m using Postgres:15. I updated the container to the latest version and did a makemigration:migrate because it told me sync was needed. I turned on DEBUG, but no change to the docker logs. The channel it is working on right now has 5000+ videos and has been running for several hours.

[mikeyounge]

docker.log

Here are my logs since updating the container about 4 hours ago. The big lag at the beginning seems to be leftover processing of a channel. Then things start to take off and the debug logs kick in with a bunch of indexing and checking happens. It is currently in a "Checking" phase and takes about 45 seconds per video. I have a bunch of media queued, but nothing has progressed far enough to actually get it to the top of the queue. Not sure if that is something that you would want to change and have it prioritize, or parallelize the media acquisition.

Hopefully this helps. Thanks.