vicuna-13b weird answer

[Y0rkieQvQ]

When I start vicuna-13B today, after it prints the answer, it starts answering itself each time. Is that normal？Or is this a new feature?
The output with three '#' in front is the sign that it starts to question and answer itself.
It's weird. There's no way to upload a video or you could see this amazing thing.
I asked it in both languages and it came up with this question:

[phnessu4]

I have the same problem.

[DearChuck]

I have the same problem，too

[bash99]

Same here

[alan-ai-learner]

@Y0rkieQvQ , see this i was having similar problem, because i was using latest fastchat with vicuna 1.0 model.
You can solve this issue by again generating the vicuna weight using the latest vicuna-delta-v1.1.
See this issue.
#409

• To be safe side in future , try installing from source with older commit.

[merrymercy]

Please check out this warning. There are several options to solve this problem

FastChat/fastchat/serve/inference.py

Lines 26 to 31 in d807fd0

	"\nYou are probably using the old Vicuna-v0 model, "
	"which will generate unexpected results with the "
	"current fschat.\nYou can try one of the following methods:\n"
	"1. Upgrade your weights to the new Vicuna-v1.1: https://github.com/lm-sys/FastChat#vicuna-weights.\n"
	"2. Use the old conversation template by `python3 -m fastchat.serve.cli --model-path /path/to/vicuna-v0 --conv-template conv_one_shot`\n"
	"3. Downgrade fschat to fschat==0.1.10 (Not recommonded).\n")

[chuckhope]

same problem

[zhisbug]

This is because we did an upgrade on the model weights. Please follow what @merrymercy suggested to upgrade the model weights and fastchat versions.