Error recoding AVI file

[nschlia]

          Thanks for pointing out the log thing :)

With an AVI file:

I used this command:

>ffmpegfs  /orig/ /trans/ --desttype=mkv --audiocodec=MP3 --autocopy=MATCH --recodesame=YES -d --logfile=log.txt

I tried to open an AVI and got the following errors:

DEBUG  : Creating media file cache.
INFO   : FFMPEGFS V2.9-1 initialising.
INFO   : Mapping '/orig/' to '/trans/'.
DEBUG  : Activating ffmpegfs inter-process link.
INFO   : Process with PID 172024 is now client, master is PID 53080.
INFO   : Initialising thread pool with max. 64 threads.
DEBUG  : [/orig/test.avi] Starting transcoder thread.
INFO   : [/orig/test.avi] Transcoding to mkv.
DEBUG  : [/orig/test.avi] Opening input file.
DEBUG  : [avi @ 0x77324c004700] Format avi probed with size=2048 and score=100
DEBUG  : [avi @ 0x77324c01e580] use odml:1
DEBUG  : [avi @ 0x77324c004700] Before avformat_find_stream_info() pos: 10252 bytes read:2457600 seeks:4 nb_streams:2
DEBUG  : [mpeg4 @ 0x77324c005540] Format yuv420p chosen by get_format().
DEBUG  : [avi @ 0x77324c004700] All info found
DEBUG  : [avi @ 0x77324c004700] After avformat_find_stream_info() pos: 26576 bytes read:2457600 seeks:4 frames:16
DEBUG  : [/orig/test.avi] Opened input codec for stream #0: MPEG-4 part 2
DEBUG  : [/orig/test.avi] Video in: mpeg4@2.37 Mbps [42:39.200]
DEBUG  : [/orig/test.avi] Opened input codec for stream #1: ATSC A/52A (AC-3)
DEBUG  : [/orig/test.avi] Audio in: ac3@192.0 kbps 1 Channels 48.000 kHz [unset]
DEBUG  : [/orig/test.avi.mkv] Opening output file.
DEBUG  : [/orig/test.avi.mkv] Opening format type 'mkv'.
INFO   : [/orig/test.avi.mkv] Copying video stream.
INFO   : [/orig/test.avi.mkv] Copying audio stream.
DEBUG  : [/orig/test.avi.mkv] Audio out: ac3@192.0 kbps 1 Channels 48.000 kHz [unset]
DEBUG  : [/orig/test.avi.mkv] Video out: mpeg4@2.37 Mbps [42:39.200]
DEBUG  : [/home/raul/.cache/ffmpegfs//trans//orig/test.avi.mkv.cache.mkv] Writing cache file.
DEBUG  : [matroska @ 0x77324c013600] get_metadata_duration returned: 0
DEBUG  : [/orig/test.avi.mkv] Pre-buffering up to 102400 bytes.
DEBUG  : [matroska @ 0x77324c013600] Starting new cluster with timestamp 0 at offset 747 bytes
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 0, dts 0, duration 32 at relative offset 9 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 32, dts 32, duration 32 at relative offset 784 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 64, dts 64, duration 32 at relative offset 1559 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 96, dts 96, duration 32 at relative offset 2334 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 128, dts 128, duration 32 at relative offset 3109 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 160, dts 160, duration 32 at relative offset 3884 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 192, dts 192, duration 32 at relative offset 4659 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 224, dts 224, duration 32 at relative offset 5434 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 256, dts 256, duration 32 at relative offset 6209 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 288, dts 288, duration 32 at relative offset 6984 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 320, dts 320, duration 32 at relative offset 7759 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 352, dts 352, duration 32 at relative offset 8534 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 384, dts 384, duration 32 at relative offset 9309 in cluster at offset 747. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 416, dts 416, duration 32 at relative offset 10084 in cluster at offset 747. TrackNumber 2, keyframe 1
WARNING: [matroska @ 0x77324c013600] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
DEBUG  : [matroska @ 0x77324c013600] Starting new cluster with timestamp 448 at offset 11612 bytes
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 448, dts 448, duration 32 at relative offset 10 in cluster at offset 11612. TrackNumber 2, keyframe 1
ERROR  : [matroska @ 0x77324c013600] Can't write packet with unknown timestamp
ERROR  : [/orig/test.avi.mkv] Could not write video frame (error 'Invalid argument').
DEBUG  : [matroska @ 0x77324c013600] Starting new cluster with timestamp 480 at offset 12403 bytes
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 480, dts 480, duration 32 at relative offset 10 in cluster at offset 12403. TrackNumber 2, keyframe 1
ERROR  : [matroska @ 0x77324c013600] Can't write packet with unknown timestamp
ERROR  : [/orig/test.avi.mkv] Could not write video frame (error 'Invalid argument').
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 512, dts 512, duration 32 at relative offset 785 in cluster at offset 12403. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 544, dts 544, duration 32 at relative offset 1560 in cluster at offset 12403. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 9 with pts 80, dts 80, duration 40 at relative offset 2335 in cluster at offset 12403. TrackNumber 1, keyframe 0
DEBUG  : [matroska @ 0x77324c013600] Starting new cluster with timestamp 576 at offset 14759 bytes
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 576, dts 576, duration 32 at relative offset 10 in cluster at offset 14759. TrackNumber 2, keyframe 1
ERROR  : [matroska @ 0x77324c013600] Can't write packet with unknown timestamp
ERROR  : [/orig/test.avi.mkv] Could not write video frame (error 'Invalid argument').
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 608, dts 608, duration 32 at relative offset 785 in cluster at offset 14759. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 9 with pts 160, dts 160, duration 40 at relative offset 1560 in cluster at offset 14759. TrackNumber 1, keyframe 0
DEBUG  : [matroska @ 0x77324c013600] Starting new cluster with timestamp 640 at offset 16340 bytes
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 640, dts 640, duration 32 at relative offset 10 in cluster at offset 16340. TrackNumber 2, keyframe 1
ERROR  : [matroska @ 0x77324c013600] Can't write packet with unknown timestamp
ERROR  : [/orig/test.avi.mkv] Could not write video frame (error 'Invalid argument').
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 672, dts 672, duration 32 at relative offset 785 in cluster at offset 16340. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 704, dts 704, duration 32 at relative offset 1560 in cluster at offset 16340. TrackNumber 2, keyframe 1
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 9 with pts 240, dts 240, duration 40 at relative offset 2335 in cluster at offset 16340. TrackNumber 1, keyframe 0
DEBUG  : [matroska @ 0x77324c013600] Starting new cluster with timestamp 736 at offset 18696 bytes
DEBUG  : [matroska @ 0x77324c013600] Writing block of size 768 with pts 736, dts 736, duration 32 at relative offset 10 in cluster at offset 18696. TrackNumber 2, keyframe 1
ERROR  : [matroska @ 0x77324c013600] Can't write packet with unknown timestamp

I'll try now with an MKV... And please feel free to suggest any experiments you would like me to try.
Cheers!

Originally posted by @aguaviva in #161 (comment)

[nschlia]

It appears that the recoder does not like the input AVI. Could you provide me with an example file? If you do not want to post it in public, we can arrange a private exchange.

[aguaviva]

Sure, do you have a place where I can upload it? Also, I will be happy to run experiments you see fit with ffmpeg. And, thanks for this great project!

[nschlia]

You could upload it to WeTransfer (https://wetransfer.com/) or DropBox (https://www.dropbox.com) and send the link to nschlia@oblivion-software.de.
I'll have to find out what the recoder dislikes about your file.

[aguaviva]

I just sent you by email a 7M clip that repros the issue in this bug

[nschlia]

I just sent you by email a 7M clip that repros the issue in this bug

First of all, with the STRICT option I recommended in #161, this works. This is because the video input codec is MPEG4, and the MKV default output codec is H264. So the video is recoded. This automatically generates proper time stamps.

Alas, the AVI is missing time stamps, see:

2024-08-08 15:44:06.035 WARNING: MUXER   [matroska @ 0x7f885407e600] Timestamps are unset in a packet for stream 0. This is deprecated and will stop working in the future. Fix your code to set the timestamps properly
2024-08-08 15:44:06.035 ERROR  : MUXER   [matroska @ 0x7f885407e600] Can't write packet with unknown timestamp
2024-08-08 15:44:06.036 ERROR  : OUTPUT  [clip.avi.mkv] Could not write video frame (error 'Invalid argument').

This means, for the copy option, FFMpegfs must generate correct time stamps...

I'll add that.

[nschlia]

The time stamps will now be added if missing. Works on the example AVI, please check (and reopen this issue) if there are still problems.

Please also have a close look at these videos if audio and video are in sync. The time stamps are created from the packet (frame) duration. They might be incorrect. But this is the best guess I can make, sorry, this is a defect in the input file and playback in VLC or similar may also be faulty.