nerdctl failed to pull image from private registry and report: snapshotter not loaded: stargz: invalid argument

[bluven]

I want to pull images from an private registry and have made ctr and crictl succeed:

root@hebei:~# ctr images pull --hosts-dir "/etc/containerd/certs.d" registry.bocloud.io:5000/fabedge/fabdns:dev
registry.bocloud.io:5000/fabedge/fabdns:dev:                                      resolved       |++++++++++++++++++++++++++++++++++++++| 
manifest-sha256:b43b7847bdf129520fa1e23f2992799edbe42f581a18adc4720941cc5164362d: done           |++++++++++++++++++++++++++++++++++++++| 
layer-sha256:0143da173e2f404dc872a5d493a0fbd52594984f839e4b1e2bf9444e71e50543:    done           |++++++++++++++++++++++++++++++++++++++| 
config-sha256:56978eceae37bcaea22f93bfa2b55dea331477eda98c5fe8880628edf464e6f5:   done           |++++++++++++++++++++++++++++++++++++++| 
layer-sha256:59bf1c3509f33515622619af21ed55bbe26d24913cedbca106468a5fb37a50c3:    done           |++++++++++++++++++++++++++++++++++++++| 
elapsed: 0.1 s                                                                    total:   0.0 B (0.0 B/s)                                         
unpacking linux/amd64 sha256:b43b7847bdf129520fa1e23f2992799edbe42f581a18adc4720941cc5164362d...
done: 11.573899ms

crictl -r unix:///run/containerd/containerd.sock pull registry.bocloud.io:5000/fabedge/fabdns:dev
Image is up to date for sha256:56978eceae37bcaea22f93bfa2b55dea331477eda98c5fe8880628edf464e6f5

but nerdctl failed and output error:

nerdctl  pull registry.bocloud.io:5000/fabedge/fabdns:dev
FATA[0000] failed to stat snapshot sha256:8d3ac3489996423f53d6087c81180006263b79f206d3fdec9e66f0e27ceb8759: snapshotter not loaded: stargz: invalid argument 

nerdctl --insecure-registry  pull registry.bocloud.io:5000/fabedge/fabdns:dev
WARN[0000] skipping verifying HTTPS certs for "registry.bocloud.io:5000" 
FATA[0000] failed to stat snapshot sha256:8d3ac3489996423f53d6087c81180006263b79f206d3fdec9e66f0e27ceb8759: snapshotter not loaded: stargz: invalid argument 

Can anyone tell me why this happened?

nerdctl version
WARN[0000] unable to determine buildctl version: exec: "buildctl": executable file not found in $PATH 
Client:
 Version:	v1.4.0
 OS/Arch:	linux/amd64
 Git commit:	7e8114a82da342cdbec9a518c5c6a1cce58105e9
 buildctl:
  Version:	

Server:
 containerd:
  Version:	v1.7.2
  GitCommit:	0cae528dd6cb557f7201036e9f43420650207b58
 runc:
  Version:	1.1.7
  GitCommit:	v1.1.7-0-g860f061b

[AkihiroSuda]

Are you trying to use stargz?
If so, you have to run containerd-stargz-grpc daemon: https://github.com/containerd/stargz-snapshotter
Otherwise you may accidentally have a stargz configuration in $CONTAINERD_SNAPSHOTTER or in /etc/nerdctl/nerdctl.toml, and probably you want to remove it: https://github.com/containerd/nerdctl/blob/main/docs/config.md