Optimising RTSP stream #398

Raeprice · 2023-04-17T19:15:15Z

Raeprice
Apr 17, 2023

Hi All, i have 4 Yi 1080P AI mix of 9FUS and BFUS and all Yi Hack went on all good :)
I do however have some image distortion when movement is happening on the image. Wondered if anyone had this and resolved? I assume its related to hardware resource on cam however i think ive disabled most things not needed, some i dont understand so leave default. I use go2rtc in Home Assistant to watch the stream.
Wondered if anyone has any tips on how to Optimise the stream/video. i run Low quality RTSP, disabled cloud etc.

roleoroleo · 2023-04-18T10:38:51Z

roleoroleo
Apr 18, 2023
Maintainer

It depends on the reason.
Please, try to consume the stream with a ffmpeg client and check if there are errors.

root@vm:~# ffmpeg -rtsp_transport tcp -i rtsp://192.168.x.x/ch0_0.h264 test.h264
ffmpeg version 4.3.5-0+deb11u1 Copyright (c) 2000-2022 the FFmpeg developers
  built with gcc 10 (Debian 10.2.1-6)
  configuration: --prefix=/usr --extra-version=0+deb11u1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-avresample --disable-filter=resample --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librsvg --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
  libavutil      56. 51.100 / 56. 51.100
  libavcodec     58. 91.100 / 58. 91.100
  libavformat    58. 45.100 / 58. 45.100
  libavdevice    58. 10.100 / 58. 10.100
  libavfilter     7. 85.100 /  7. 85.100
  libavresample   4.  0.  0 /  4.  0.  0
  libswscale      5.  7.100 /  5.  7.100
  libswresample   3.  7.100 /  3.  7.100
  libpostproc    55.  7.100 / 55.  7.100
Guessed Channel Layout for Input Stream #0.1 : mono
Input #0, rtsp, from 'rtsp://192.168.x.x/ch0_0.h264':
  Metadata:
    title           : Session streamed by "rRTSPServer"
    comment         : ch0_0.h264
  Duration: N/A, start: -0.010375, bitrate: N/A
    Stream #0:0: Video: h264 (Main), yuvj420p(pc, progressive), 1920x1088, 20 fps, 20 tbr, 90k tbn, 40 tbc
    Stream #0:1: Audio: pcm_alaw, 8000 Hz, mono, s16, 64 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x55b3ed395540] using cpu capabilities: MMX2 SSE2Fast SSSE3 Cache64 SlowAtom SlowPshufb
[libx264 @ 0x55b3ed395540] profile High, level 4.0, 4:2:0, 8-bit
Output #0, h264, to 'test.h264':
  Metadata:
    title           : Session streamed by "rRTSPServer"
    comment         : ch0_0.h264
    encoder         : Lavf58.45.100
    Stream #0:0: Video: h264 (libx264), yuvj420p(pc), 1920x1088, q=-1--1, 20 fps, 20 tbn, 20 tbc
    Metadata:
      encoder         : Lavc58.91.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=   72 fps=8.7 q=28.0 size=     205kB time=00:00:01.00 bitrate=1683.0kbits/s dup=8 drop=1 speed=0.121x

9 replies

roleoroleo Apr 26, 2023
Maintainer

The second example doesn't show dispatched frames and the output file is empty.
This is strange. Please try again.

Raeprice Apr 26, 2023
Author

The second example doesn't show dispatched frames and the output file is empty. This is strange. Please try again.

I run again when movement was happening with ghosting and lag (Worth noting i used Low quality stream for this one)

ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
  built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
  configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
  libavutil 56. 70.100 / 56. 70.100
  libavcodec 58.134.100 / 58.134.100
  libavformat 58. 76.100 / 58. 76.100
  libavdevice 58. 13.100 / 58. 13.100
  libavfilter 7.110.100 / 7.110.100
  libswscale 5. 9.100 / 5. 9.100
  libswresample 3. 9.100 / 3. 9.100
  libpostproc 55. 9.100 / 55. 9.100
Input #0, rtsp, from 'rtsp://[192.168.1.7/ch0_1.h264](http://192.168.1.7/ch0_1.h264)':
  Metadata:
    title : Session streamed by "rRTSPServer"
    comment : ch0_1.h264
  Duration: N/A, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 640x360, 20 fps, 20 tbr, 90k tbn, 40 tbc
  Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp
File 'test2.h264' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
Press [q] to stop, [?] for help
[libx264 @ 0x55bd5d24a200] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x55bd5d24a200] profile High, level 2.2, 4:2:0, 8-bit
Output #0, h264, to 'test2.h264':
  Metadata:
    title : Session streamed by "rRTSPServer"
    comment : ch0_1.h264
    encoder : Lavf58.76.100
  Stream #0:0: Video: h264, yuvj420p(pc, bt709, progressive), 640x360, q=2-31, 20 fps, 20 tbn
    Metadata:
      encoder : Lavc58.134.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame= 71 fps=0.0 q=28.0 size= 41kB time=00:00:01.40 bitrate= 242.0kbits/s dup=70 dr
frame= 96 fps=0.0 q=28.0 size= 42kB time=00:00:02.65 bitrate= 129.6kbits/s dup=91 dr
frame= 221 fps=208 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps=140 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps=104 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps= 84 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps= 71 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps= 60 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps= 52 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 221 fps= 46 q=28.0 size= 101kB time=00:00:08.90 bitrate= 92.7kbits/s dup=179 d
frame= 313 fps= 57 q=28.0 size= 214kB time=00:00:13.50 bitrate= 129.7kbits/s dup=270 d
frame= 313 fps= 52 q=28.0 size= 214kB time=00:00:13.50 bitrate= 129.7kbits/s dup=270 d
frame= 313 fps= 48 q=28.0 size= 214kB time=00:00:13.50 bitrate= 129.7kbits/s dup=270 d
frame= 313 fps= 44 q=28.0 size= 214kB time=00:00:13.50 bitrate= 129.7kbits/s dup=270 d
frame= 355 fps= 46 q=28.0 size= 238kB time=00:00:15.60 bitrate= 125.2kbits/s dup=311 d
frame= 355 fps= 43 q=28.0 size= 238kB time=00:00:15.60 bitrate= 125.2kbits/s dup=311 d
frame= 355 fps= 41 q=28.0 size= 238kB time=00:00:15.60 bitrate= 125.2kbits/s dup=311 d
frame= 355 fps= 38 q=28.0 size= 238kB time=00:00:15.60 bitrate= 125.2kbits/s dup=311 d
frame= 355 fps= 36 q=28.0 size= 238kB time=00:00:15.60 bitrate= 125.2kbits/s dup=311 d
frame= 406 fps= 39 q=28.0 size= 256kB time=00:00:18.15 bitrate= 115.5kbits/s dup=361 d
frame= 406 fps= 37 q=28.0 size= 256kB time=00:00:18.15 bitrate= 115.5kbits/s dup=361 d
frame= 436 fps= 38 q=28.0 size= 256kB time=00:00:19.65 bitrate= 106.7kbits/s dup=385 d
frame= 446 fps= 37 q=28.0 size= 256kB time=00:00:20.15 bitrate= 104.1kbits/s dup=387 d
frame= 457 fps= 37 q=28.0 size= 256kB time=00:00:20.70 bitrate= 101.3kbits/s dup=389 d
frame= 468 fps= 36 q=28.0 size= 256kB time=00:00:21.25 bitrate= 98.7kbits/s dup=391 d
frame= 479 fps= 35 q=28.0 size= 256kB time=00:00:21.80 bitrate= 96.2kbits/s dup=394 d
frame= 479 fps= 34 q=28.0 size= 256kB time=00:00:21.80 bitrate= 96.2kbits/s dup=394 d
frame= 481 fps= 33 q=28.0 size= 256kB time=00:00:21.90 bitrate= 95.8kbits/s dup=395 d
frame= 511 fps= 34 q=28.0 size= 256kB time=00:00:23.40 bitrate= 89.6kbits/s dup=418 d
frame= 522 fps= 33 q=28.0 size= 256kB time=00:00:23.95 bitrate= 87.6kbits/s dup=421 d
frame= 533 fps= 33 q=28.0 size= 256kB time=00:00:24.50 bitrate= 85.6kbits/s dup=423 d
frame= 543 fps= 32 q=28.0 size= 256kB time=00:00:25.00 bitrate= 83.9kbits/s dup=425 d
frame= 543 fps= 31 q=28.0 size= 256kB time=00:00:25.00 bitrate= 83.9kbits/s dup=425 d
frame= 543 fps= 30 q=28.0 size= 256kB time=00:00:25.00 bitrate= 83.9kbits/s dup=425 d
frame= 543 fps= 30 q=28.0 size= 256kB time=00:00:25.00 bitrate= 83.9kbits/s dup=425 d
frame= 543 fps= 29 q=28.0 size= 256kB time=00:00:25.00 bitrate= 83.9kbits/s dup=425 d
frame= 593 fps= 31 q=28.0 size= 256kB time=00:00:27.50 bitrate= 76.3kbits/s dup=473 d
frame= 593 fps= 30 q=28.0 size= 256kB time=00:00:27.50 bitrate= 76.3kbits/s dup=473 d
frame= 594 fps= 29 q=28.0 size= 256kB time=00:00:27.55 bitrate= 76.1kbits/s dup=473 d
frame= 626 fps= 30 q=28.0 size= 256kB time=00:00:29.15 bitrate= 71.9kbits/s dup=497 d
frame= 637 fps= 30 q=28.0 size= 256kB time=00:00:29.70 bitrate= 70.6kbits/s dup=500 d
frame= 647 fps= 29 q=28.0 size= 256kB time=00:00:30.20 bitrate= 69.4kbits/s dup=502 d
frame= 651 fps= 29 q=28.0 Lsize= 535kB time=00:00:32.45 bitrate= 135.1kbits/s dup=503 drop=0 speed=1.46x    
video:535kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000%
[libx264 @ 0x55bd5d24a200] frame I:3 Avg QP:17.57 size: 53654
[libx264 @ 0x55bd5d24a200] frame P:228 Avg QP:20.83 size: 1533
[libx264 @ 0x55bd5d24a200] frame B:420 Avg QP:31.30 size: 90
[libx264 @ 0x55bd5d24a200] consecutive B-frames: 9.2% 12.9% 4.1% 73.7%
[libx264 @ 0x55bd5d24a200] mb I I16..4: 7.6% 14.7% 77.7%
[libx264 @ 0x55bd5d24a200] mb P I16..4: 0.1% 0.2% 0.6% P16..4: 10.9% 1.4% 0.9% 0.0% 0.0% skip:86.0%
[libx264 @ 0x55bd5d24a200] mb B I16..4: 0.0% 0.0% 0.0% B16..8: 2.5% 0.1% 0.0% direct: 0.1% skip:97.2% L0:36.4% L1:62.3% BI: 1.4%
[libx264 @ 0x55bd5d24a200] 8x8 transform intra:19.2% inter:13.8%
[libx264 @ 0x55bd5d24a200] coded y,uvDC,uvAC intra: 91.7% 65.4% 42.1% inter: 2.0% 1.1% 0.2%
[libx264 @ 0x55bd5d24a200] i16 v,h,dc,p: 11% 7% 35% 47%
[libx264 @ 0x55bd5d24a200] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 30% 15% 15% 5% 5% 10% 4% 8% 9%
[libx264 @ 0x55bd5d24a200] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 12% 13% 8% 7% 8% 9% 9% 9%
[libx264 @ 0x55bd5d24a200] i8c dc,h,v,p: 41% 20% 27% 12%
[libx264 @ 0x55bd5d24a200] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x55bd5d24a200] ref P L0: 87.8% 5.1% 6.1% 1.0%
[libx264 @ 0x55bd5d24a200] ref B L0: 94.5% 5.4% 0.1%
[libx264 @ 0x55bd5d24a200] ref B L1: 98.4% 1.6%
[libx264 @ 0x55bd5d24a200] kb/s:134.72

roleoroleo Apr 30, 2023
Maintainer

There are no error in the log, so no network problem.
Are there other client consuming the stream at the same time?
Does the problem also occurs with other clients, for example with vlc?
I get some distortion too but not very often.

Raeprice May 30, 2023
Author

Hi, So sorry for the late response! i had to park this due to other commitment!
Yes this does happen in VLC, i recently setup recording on this unit and have a few examples i can share of the footage and what happens if needed. Still really struggling with this may even need to look to replace these cameras if i cant get it sorted :( really want to avoid this. Any other troubleshooting you can suggest? I am not overly knowledgable on how all this truly works.
Why would the stream in the cloud app work great, where the RTSP stream is ghosting and freezing when movement shows?

roleoroleo Jun 4, 2023
Maintainer

Please, share some example.

Why would the stream in the cloud app work great, where the RTSP stream is ghosting and freezing when movement shows?

When there is a movement, the codec has to do more work.
The frames are bigger and the cpu is used more.
But it shouldn't be a problem, especially if you use the low resolution.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Optimising RTSP stream #398

{{title}}

Replies: 1 comment 9 replies

{{title}}

{{title}}

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

Select a reply

Optimising RTSP stream #398

Raeprice Apr 17, 2023

Replies: 1 comment · 9 replies

roleoroleo Apr 18, 2023 Maintainer

roleoroleo Apr 26, 2023 Maintainer

Raeprice Apr 26, 2023 Author

roleoroleo Apr 30, 2023 Maintainer

Raeprice May 30, 2023 Author

roleoroleo Jun 4, 2023 Maintainer

Raeprice
Apr 17, 2023

Replies: 1 comment 9 replies

roleoroleo
Apr 18, 2023
Maintainer

roleoroleo Apr 26, 2023
Maintainer

Raeprice Apr 26, 2023
Author

roleoroleo Apr 30, 2023
Maintainer

Raeprice May 30, 2023
Author

roleoroleo Jun 4, 2023
Maintainer