Can't start tcmu-runner.service

[Zhihaoi]

Hello, I can't start tcmu-runner.service due to libphoton.so,

$ systemctl status tcmu-runner.service
● tcmu-runner.service - LIO Userspace-passthrough daemon
     Loaded: loaded (/lib/systemd/system/tcmu-runner.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Mon 2022-09-19 19:04:49 CST; 7s ago
       Docs: man:tcmu-runner(8)
    Process: 43923 ExecStart=/usr/bin/tcmu-runner (code=exited, status=127)
   Main PID: 43923 (code=exited, status=127)

9月 19 19:04:49 zzh-MSI-R5 systemd[1]: Starting LIO Userspace-passthrough daemon...
9月 19 19:04:49 zzh-MSI-R5 tcmu-runner[43923]: /usr/bin/tcmu-runner: error while loading shared libraries: libphoton.so: cannot open shared object file: No such file or directory
9月 19 19:04:49 zzh-MSI-R5 systemd[1]: tcmu-runner.service: Main process exited, code=exited, status=127/n/a
9月 19 19:04:49 zzh-MSI-R5 systemd[1]: tcmu-runner.service: Failed with result 'exit-code'.
9月 19 19:04:49 zzh-MSI-R5 systemd[1]: Failed to start LIO Userspace-passthrough daemon.

So what is libphoton.so?

[lxbsz]

What OS are you using ? As I know there is no direct dependency on the libphoton.so from tcmu-runner.

[lxbsz]

The followings are the dependencies from my env:

[root@node01 tcmu-runner]# ldd tcmu-runner
	linux-vdso.so.1 (0x00007fff111f1000)
	libtcmu.so.2 => /data/tcmu-runner/libtcmu.so.2 (0x00007fe13606e000)
	libgio-2.0.so.0 => /lib64/libgio-2.0.so.0 (0x00007fe135cc5000)
	libgobject-2.0.so.0 => /lib64/libgobject-2.0.so.0 (0x00007fe135a72000)
	libglib-2.0.so.0 => /lib64/libglib-2.0.so.0 (0x00007fe135759000)
	libpthread.so.0 => /lib64/libpthread.so.0 (0x00007fe135539000)
	libdl.so.2 => /lib64/libdl.so.2 (0x00007fe135335000)
	libkmod.so.2 => /lib64/libkmod.so.2 (0x00007fe13511d000)
	libtcmalloc.so.4 => /lib64/libtcmalloc.so.4 (0x00007fe134d21000)
	libnl-3.so.200 => /lib64/libnl-3.so.200 (0x00007fe134afe000)
	libnl-genl-3.so.200 => /lib64/libnl-genl-3.so.200 (0x00007fe1348f7000)
	libc.so.6 => /lib64/libc.so.6 (0x00007fe134534000)
	/lib64/ld-linux-x86-64.so.2 (0x00007fe13628b000)
	libffi.so.6 => /lib64/libffi.so.6 (0x00007fe13432b000)
	libgmodule-2.0.so.0 => /lib64/libgmodule-2.0.so.0 (0x00007fe134127000)
	libgnutls.so.30 => /lib64/libgnutls.so.30 (0x00007fe133d36000)
	libpcre.so.1 => /lib64/libpcre.so.1 (0x00007fe133ac5000)
	libz.so.1 => /lib64/libz.so.1 (0x00007fe1338ae000)
	libselinux.so.1 => /lib64/libselinux.so.1 (0x00007fe133684000)
	libresolv.so.2 => /lib64/libresolv.so.2 (0x00007fe13346d000)
	libmount.so.1 => /lib64/libmount.so.1 (0x00007fe133213000)
	libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00007fe132ffb000)
	liblzma.so.5 => /lib64/liblzma.so.5 (0x00007fe132dd4000)
	libssl.so.1.1 => /lib64/libssl.so.1.1 (0x00007fe132b40000)
	libcrypto.so.1.1 => /lib64/libcrypto.so.1.1 (0x00007fe13265a000)
	libunwind.so.8 => /lib64/libunwind.so.8 (0x00007fe132442000)
	libstdc++.so.6 => /lib64/libstdc++.so.6 (0x00007fe1320ad000)
	libm.so.6 => /lib64/libm.so.6 (0x00007fe131d2b000)
	libp11-kit.so.0 => /lib64/libp11-kit.so.0 (0x00007fe1319f8000)
	libidn2.so.0 => /lib64/libidn2.so.0 (0x00007fe1317da000)
	libunistring.so.2 => /lib64/libunistring.so.2 (0x00007fe131459000)
	libtasn1.so.6 => /lib64/libtasn1.so.6 (0x00007fe131246000)
	libnettle.so.6 => /lib64/libnettle.so.6 (0x00007fe13100c000)
	libhogweed.so.4 => /lib64/libhogweed.so.4 (0x00007fe130ddb000)
	libgmp.so.10 => /lib64/libgmp.so.10 (0x00007fe130b43000)
	libpcre2-8.so.0 => /lib64/libpcre2-8.so.0 (0x00007fe1308bf000)
	libblkid.so.1 => /lib64/libblkid.so.1 (0x00007fe13066c000)
	libuuid.so.1 => /lib64/libuuid.so.1 (0x00007fe130464000)
	librt.so.1 => /lib64/librt.so.1 (0x00007fe13025c000)

[Zhihaoi]

Thanks for your reply, but I have other problems when start tcmu-runner:

$ sudo tcmu-runner 
tcmu-runner: symbol lookup error: tcmu-runner: undefined symbol: tcmu_iovec_length

and the /var/log/tcmu-runner.log show:

2022-09-19 17:46:38.613 41981 [CRIT] main:1302: Starting...
2022-09-19 17:46:38.614 41981 [INFO] tcmur_register_handler:92: Handler fbo is registered
2022-09-19 17:46:38.614 41981 [INFO] tcmur_register_handler:92: Handler zbc is registered
2022-09-19 17:46:38.614 41981 [INFO] tcmur_register_handler:92: Handler qcow is registered
2022-09-19 17:46:38.623 41981 [INFO] tcmur_register_handler:92: Handler rbd is registered
2022-09-19 19:04:13.346 41981 [CRIT] main:1425: Exiting...
2022-09-19 19:04:13.349 41981 [INFO] tcmu_rbd_destroy:1707: destroying the rbd handler
2022-09-19 19:04:19.754 43526 [CRIT] main:1302: Starting...
2022-09-19 19:04:19.756 43526 [INFO] tcmur_register_handler:92: Handler fbo is registered
2022-09-19 19:04:19.756 43526 [INFO] tcmur_register_handler:92: Handler zbc is registered
2022-09-19 19:04:19.757 43526 [INFO] tcmur_register_handler:92: Handler qcow is registered
2022-09-19 19:04:19.764 43526 [INFO] tcmur_register_handler:92: Handler rbd is registered
2022-09-19 19:04:21.169 43526 [CRIT] main:1425: Exiting...
2022-09-19 19:04:21.171 43526 [INFO] tcmu_rbd_destroy:1707: destroying the rbd handler
2022-09-20 10:56:13.822 52417 [CRIT] main:1302: Starting...
2022-09-20 10:56:13.822 52417 [ERROR] main:1350: couldn't open handlers

Then the following is the OS info I'm using:

$ sudo lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description:    Ubuntu 20.04.5 LTS
Release:        20.04
Codename:       focal
$ uname -a 
Linux  5.15.0-46-generic #49~20.04.1-Ubuntu SMP Thu Aug 4 19:15:44 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux

[lxbsz]

BTW, where did you get the tcmu-runner package ? Have you tried to build from source yourself ?

[lxbsz]

I never built this in Ubuntu yet. So not sure what has happened there!