start agent error: data did not match any variant of untagged enum ModelWrapper at line 757479 column 3 #665
Labels
bug
Something isn't working
Comments
|
I tried loading the default llama-checkpoint (checkpoints/fish-speech-1.4) and it is fine. But the fish-agent checkpoint (checkpoints/fish-agent-v0.1-3b/) is not loading properly. |
|
try redownloading? |
Yes, I tried re-downloading it twice, but it didn't work. |
update it to |
OK it works! Thank you! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Self Checks
Cloud or Self Hosted
Cloud
Environment Details
Ubuntu22.04
python_libgcc_mutex 0.1 main
_openmp_mutex 5.1 1_gnu
absl-py 2.1.0 pypi_0 pypi
aiofiles 23.2.1 pypi_0 pypi
aiohttp 3.9.5 pypi_0 pypi
aiosignal 1.3.1 pypi_0 pypi
aliyun-python-sdk-core 2.15.1 pypi_0 pypi
aliyun-python-sdk-kms 2.16.3 pypi_0 pypi
annotated-types 0.7.0 pypi_0 pypi
antlr4-python3-runtime 4.9.3 pypi_0 pypi
anyio 4.4.0 pypi_0 pypi
async-timeout 4.0.3 pypi_0 pypi
attrs 23.2.0 pypi_0 pypi
audioread 3.0.1 pypi_0 pypi
av 12.3.0 pypi_0 pypi
baize 0.22.1 pypi_0 pypi
bzip2 1.0.8 h5eee18b_6
ca-certificates 2024.9.24 h06a4308_0
cachetools 5.4.0 pypi_0 pypi
certifi 2024.7.4 pypi_0 pypi
cffi 1.16.0 pypi_0 pypi
charset-normalizer 3.3.2 pypi_0 pypi
click 8.1.7 pypi_0 pypi
coloredlogs 15.0.1 pypi_0 pypi
contourpy 1.2.1 pypi_0 pypi
crcmod 1.7 pypi_0 pypi
cryptography 43.0.0 pypi_0 pypi
ctranslate2 4.3.1 pypi_0 pypi
cycler 0.12.1 pypi_0 pypi
datasets 2.18.0 pypi_0 pypi
decorator 5.1.1 pypi_0 pypi
dill 0.3.8 pypi_0 pypi
docker-pycreds 0.4.0 pypi_0 pypi
editdistance 0.8.1 pypi_0 pypi
einops 0.8.0 pypi_0 pypi
einx 0.2.2 pypi_0 pypi
exceptiongroup 1.2.2 pypi_0 pypi
fastapi 0.112.0 pypi_0 pypi
faster-whisper 1.0.3 pypi_0 pypi
ffmpy 0.4.0 pypi_0 pypi
filelock 3.15.4 pypi_0 pypi
fish-speech 0.1.0 pypi_0 pypi
flatbuffers 24.3.25 pypi_0 pypi
fonttools 4.53.1 pypi_0 pypi
frozendict 2.4.4 pypi_0 pypi
frozenlist 1.4.1 pypi_0 pypi
fsspec 2024.2.0 pypi_0 pypi
funasr 1.1.4 pypi_0 pypi
gitdb 4.0.11 pypi_0 pypi
gitpython 3.1.43 pypi_0 pypi
gradio 4.40.0 pypi_0 pypi
gradio-client 1.2.0 pypi_0 pypi
grpcio 1.65.4 pypi_0 pypi
h11 0.14.0 pypi_0 pypi
httpcore 1.0.5 pypi_0 pypi
httpx 0.27.0 pypi_0 pypi
huggingface-hub 0.24.5 pypi_0 pypi
humanfriendly 10.0 pypi_0 pypi
hydra-core 1.3.2 pypi_0 pypi
idna 3.7 pypi_0 pypi
importlib-resources 6.4.0 pypi_0 pypi
jaconv 0.4.0 pypi_0 pypi
jamo 0.4.1 pypi_0 pypi
jieba 0.42.1 pypi_0 pypi
jinja2 3.1.4 pypi_0 pypi
jmespath 0.10.0 pypi_0 pypi
joblib 1.4.2 pypi_0 pypi
kaldiio 2.18.0 pypi_0 pypi
kiwisolver 1.4.5 pypi_0 pypi
kui 1.8.1 pypi_0 pypi
lazy-loader 0.4 pypi_0 pypi
ld_impl_linux-64 2.40 h12ee557_0
libffi 3.4.4 h6a678d5_1
libgcc-ng 11.2.0 h1234567_1
libgomp 11.2.0 h1234567_1
librosa 0.10.2.post1 pypi_0 pypi
libstdcxx-ng 11.2.0 h1234567_1
libuuid 1.41.5 h5eee18b_0
lightning 2.4.0 pypi_0 pypi
lightning-utilities 0.11.6 pypi_0 pypi
llvmlite 0.43.0 pypi_0 pypi
loguru 0.7.2 pypi_0 pypi
loralib 0.1.2 pypi_0 pypi
markdown 3.6 pypi_0 pypi
markdown-it-py 3.0.0 pypi_0 pypi
markupsafe 2.1.5 pypi_0 pypi
matplotlib 3.9.1.post1 pypi_0 pypi
mdurl 0.1.2 pypi_0 pypi
modelscope 1.17.1 pypi_0 pypi
mpmath 1.3.0 pypi_0 pypi
msgpack 1.0.8 pypi_0 pypi
multidict 6.0.5 pypi_0 pypi
multiprocess 0.70.16 pypi_0 pypi
natsort 8.4.0 pypi_0 pypi
ncurses 6.4 h6a678d5_0
networkx 3.3 pypi_0 pypi
numba 0.60.0 pypi_0 pypi
numpy 1.26.4 pypi_0 pypi
nvidia-cublas-cu12 12.1.3.1 pypi_0 pypi
nvidia-cuda-cupti-cu12 12.1.105 pypi_0 pypi
nvidia-cuda-nvrtc-cu12 12.1.105 pypi_0 pypi
nvidia-cuda-runtime-cu12 12.1.105 pypi_0 pypi
nvidia-cudnn-cu12 9.1.0.70 pypi_0 pypi
nvidia-cufft-cu12 11.0.2.54 pypi_0 pypi
nvidia-curand-cu12 10.3.2.106 pypi_0 pypi
nvidia-cusolver-cu12 11.4.5.107 pypi_0 pypi
nvidia-cusparse-cu12 12.1.0.106 pypi_0 pypi
nvidia-nccl-cu12 2.20.5 pypi_0 pypi
nvidia-nvjitlink-cu12 12.6.20 pypi_0 pypi
nvidia-nvtx-cu12 12.1.105 pypi_0 pypi
omegaconf 2.3.0 pypi_0 pypi
onnxruntime 1.18.1 pypi_0 pypi
opencc-python-reimplemented 0.1.7 pypi_0 pypi
openssl 3.0.15 h5eee18b_0
orjson 3.10.7 pypi_0 pypi
ormsgpack 1.5.0 pypi_0 pypi
oss2 2.18.6 pypi_0 pypi
packaging 24.1 pypi_0 pypi
pandas 2.2.2 pypi_0 pypi
pillow 10.4.0 pypi_0 pypi
pip 24.2 py310h06a4308_0
platformdirs 4.2.2 pypi_0 pypi
pooch 1.8.2 pypi_0 pypi
protobuf 5.27.3 pypi_0 pypi
psutil 6.0.0 pypi_0 pypi
pyarrow 17.0.0 pypi_0 pypi
pyarrow-hotfix 0.6 pypi_0 pypi
pyaudio 0.2.14 pypi_0 pypi
pycparser 2.22 pypi_0 pypi
pycryptodome 3.20.0 pypi_0 pypi
pydantic 2.8.2 pypi_0 pypi
pydantic-core 2.20.1 pypi_0 pypi
pydub 0.25.1 pypi_0 pypi
pygments 2.18.0 pypi_0 pypi
pynndescent 0.5.13 pypi_0 pypi
pyparsing 3.1.2 pypi_0 pypi
pyrootutils 1.0.4 pypi_0 pypi
python 3.10.15 he870216_1
python-dateutil 2.9.0.post0 pypi_0 pypi
python-dotenv 1.0.1 pypi_0 pypi
python-multipart 0.0.9 pypi_0 pypi
pytorch-lightning 2.4.0 pypi_0 pypi
pytorch-wpe 0.0.1 pypi_0 pypi
pytz 2024.1 pypi_0 pypi
pyyaml 6.0.1 pypi_0 pypi
readline 8.2 h5eee18b_0
regex 2024.7.24 pypi_0 pypi
requests 2.32.3 pypi_0 pypi
resampy 0.4.3 pypi_0 pypi
rich 13.7.1 pypi_0 pypi
ruff 0.6.1 pypi_0 pypi
safetensors 0.4.4 pypi_0 pypi
scikit-learn 1.5.1 pypi_0 pypi
scipy 1.14.0 pypi_0 pypi
semantic-version 2.10.0 pypi_0 pypi
sentencepiece 0.2.0 pypi_0 pypi
sentry-sdk 2.13.0 pypi_0 pypi
setproctitle 1.3.3 pypi_0 pypi
setuptools 75.1.0 py310h06a4308_0
shellingham 1.5.4 pypi_0 pypi
silero-vad 5.1 pypi_0 pypi
six 1.16.0 pypi_0 pypi
smmap 5.0.1 pypi_0 pypi
sniffio 1.3.1 pypi_0 pypi
soundfile 0.12.1 pypi_0 pypi
soxr 0.4.0 pypi_0 pypi
sqlite 3.45.3 h5eee18b_0
starlette 0.37.2 pypi_0 pypi
sympy 1.13.2 pypi_0 pypi
tensorboard 2.17.1 pypi_0 pypi
tensorboard-data-server 0.7.2 pypi_0 pypi
tensorboardx 2.6.2.2 pypi_0 pypi
threadpoolctl 3.5.0 pypi_0 pypi
tk 8.6.14 h39e8969_0
tokenizers 0.19.1 pypi_0 pypi
tomlkit 0.12.0 pypi_0 pypi
torch 2.4.0 pypi_0 pypi
torch-complex 0.4.4 pypi_0 pypi
torchaudio 2.4.0 pypi_0 pypi
torchmetrics 1.4.1 pypi_0 pypi
torchvision 0.19.0 pypi_0 pypi
tqdm 4.66.5 pypi_0 pypi
transformers 4.44.2 pypi_0 pypi
triton 3.0.0 pypi_0 pypi
typer 0.12.4 pypi_0 pypi
typing-extensions 4.12.2 pypi_0 pypi
tzdata 2024.1 pypi_0 pypi
umap-learn 0.5.6 pypi_0 pypi
urllib3 2.2.2 pypi_0 pypi
uvicorn 0.30.6 pypi_0 pypi
vector-quantize-pytorch 1.15.3 pypi_0 pypi
wandb 0.17.7 pypi_0 pypi
websockets 12.0 pypi_0 pypi
werkzeug 3.0.3 pypi_0 pypi
wheel 0.44.0 py310h06a4308_0
xxhash 3.5.0 pypi_0 pypi
xz 5.4.6 h5eee18b_1
yarl 1.9.4 pypi_0 pypi
zlib 1.2.13 h5eee18b_1
zstandard 0.23.0 pypi_0 pypi
Steps to Reproduce
python -m tools.api --llama-checkpoint-path checkpoints/fish-agent-v0.1-3b/ --mode agent --compile
✔️ Expected Behavior
I followed the instructions in start_agent.md to start this agent and encountered an unexpected error.
❌ Actual Behavior
I followed the instructions in start_agent.md to start this agent and encountered an unexpected error.
ERROR: Traceback (most recent call last):
File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/kui/asgi/lifespan.py", line 34, in call
result = handler(app)
File "/data/agent/fish-speech/tools/api.py", line 888, in initialize_app
llama_queue, tokenizer, config = launch_thread_safe_queue_agent(
File "/data/agent/fish-speech/tools/llama/generate.py", line 928, in launch_thread_safe_queue_agent
tokenizer = AutoTokenizer.from_pretrained(checkpoint_path)
File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 897, in from_pretrained
return tokenizer_class.from_pretrained(pretrained_model_name_or_path, *inputs, **kwargs)
File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained
return cls._from_pretrained(
File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/models/qwen2/tokenization_qwen2_fast.py", line 120, in init
super().init(
File "/root/miniconda3/envs/fishagent/lib/python3.10/site-packages/transformers/tokenization_utils_fast.py", line 115, in init
fast_tokenizer = TokenizerFast.from_file(fast_tokenizer_file)
Exception: data did not match any variant of untagged enum ModelWrapper at line 757479 column 3
ERROR: Application startup failed. Exiting.
The text was updated successfully, but these errors were encountered: