Skip to content

mtmd: dsocr-tiles test fixes - #25486

Merged
ngxson merged 1 commit into
ggml-org:xsn/mtmd_ds_ocr_tilesfrom
sfallah:sf/pr24717-test-fixes
Jul 10, 2026
Merged

mtmd: dsocr-tiles test fixes#25486
ngxson merged 1 commit into
ggml-org:xsn/mtmd_ds_ocr_tilesfrom
sfallah:sf/pr24717-test-fixes

Conversation

@sfallah

@sfallah sfallah commented Jul 9, 2026

Copy link
Copy Markdown
Contributor
  • test-deepseek-ocr: relax v1 single-view tolerance; drop trailing prompt space; make DRY opt-in and n_predict model-specific

AI usage disclosure: YES - I used AI assistance for code review, debugging, implementation checks, and testing. I have reviewed the submitted changes and take responsibility for the full contents of this PR.

…pt space; make DRY opt-in and n_predict model-specific
@sfallah
sfallah requested a review from a team as a code owner July 9, 2026 14:19
@sfallah

sfallah commented Jul 9, 2026

Copy link
Copy Markdown
Contributor Author

The reg-test gate/tolerance is relaxed because testing with the HF ref on CPU and CUDA (and a modified HF ref on Metal/mps) showed the baseline should be set higher, and the tolerance should be wider when considering different weight dtypes and backends. This is all verified and reproducible: https://github.com/sfallah/llama-mtmd-eval

@github-actions github-actions Bot added the mtmd Related to multimodal functionality (video/image/audio) label Jul 9, 2026
@ngxson
ngxson merged commit 83c7477 into ggml-org:xsn/mtmd_ds_ocr_tiles Jul 10, 2026
3 checks passed
@sfallah
sfallah deleted the sf/pr24717-test-fixes branch July 10, 2026 13:40
ngxson added a commit that referenced this pull request Jul 10, 2026
* mtmd: deepseek-ocr v1 multi-tile dynamic resolution + unified image-preprocessors for both versions (ds-ocr v1 and v2)

* remove hacky API

* fuse row into a long image

* almost working

* adapt to new preprocessor api

* rm debugging printf

* improve

* mtmd: dsocr-tiles fixes (#25481)

* ds-ocr img-preproc fuse_row tile-drop fix for multi rows and columns images

* mtmd drop the duplicate redundant img_end

* deepseekocr graph simplify CLS broadcast cleanup

* test-deepseek-ocr: relax v1 single-view tolerance; drop trailing prompt space; make DRY opt-in and n_predict model-specific (#25486)

---------

Co-authored-by: Saba Fallah <10401143+sfallah@users.noreply.github.com>
Co-authored-by: Saba Fallah <sabafallah@gmail.com>
satindergrewal pushed a commit to satindergrewal/llama.cpp that referenced this pull request Aug 12, 2026
* mtmd: deepseek-ocr v1 multi-tile dynamic resolution + unified image-preprocessors for both versions (ds-ocr v1 and v2)

* remove hacky API

* fuse row into a long image

* almost working

* adapt to new preprocessor api

* rm debugging printf

* improve

* mtmd: dsocr-tiles fixes (ggml-org#25481)

* ds-ocr img-preproc fuse_row tile-drop fix for multi rows and columns images

* mtmd drop the duplicate redundant img_end

* deepseekocr graph simplify CLS broadcast cleanup

* test-deepseek-ocr: relax v1 single-view tolerance; drop trailing prompt space; make DRY opt-in and n_predict model-specific (ggml-org#25486)

---------

Co-authored-by: Saba Fallah <10401143+sfallah@users.noreply.github.com>
Co-authored-by: Saba Fallah <sabafallah@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

mtmd Related to multimodal functionality (video/image/audio)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants