docs: 添加 llama.cpp 关于 tokenize 错误的解决方案说明#17729
Open
megemini wants to merge 1 commit intoPaddlePaddle:mainfrom
Open
docs: 添加 llama.cpp 关于 tokenize 错误的解决方案说明#17729megemini wants to merge 1 commit intoPaddlePaddle:mainfrom
megemini wants to merge 1 commit intoPaddlePaddle:mainfrom
Conversation
|
Thanks for your contribution! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
ggml-org/llama.cpp#18825 添加了 llama.cpp 对于 PaddleOCR-VL 的支持，但是，llama.cpp 最近修改了 template 的解析逻辑，导致
llama-server命令直接使用会报错tokenize: error: number of bitmaps (1) does not match number of markers (0).ggml-org/llama.cpp#19799 尝试提交 hotfix 解决这个问题，但是 llama.cpp 那边希望 PaddleOCR 这里修复 template 来解决这个问题。
为了用户在此问题被解决前能够正常使用，我在
https://modelscope.cn/models/megemini/PaddleOCR-VL-1.5-GGUF/files
https://modelscope.cn/models/megemini/PaddleOCR-VL-GGUF/files
添加了修复后的 template 文件（没有进行格式化，以方便区分原模板），并提交此 PR 以说明情况。