Skip to content

Fix/draft load context - #4

Closed
wadealexc wants to merge 3 commits into
masterfrom
fix/draft-load-context
Closed

Fix/draft load context#4
wadealexc wants to merge 3 commits into
masterfrom
fix/draft-load-context

Conversation

@wadealexc

Copy link
Copy Markdown
Owner

Overview

Additional information

Requirements

@github-actions github-actions Bot added the server label Jul 1, 2026
@wadealexc
wadealexc force-pushed the fix/draft-load-context branch 2 times, most recently from c257309 to 0a0c16e Compare July 6, 2026 13:27
wadealexc added 2 commits July 7, 2026 09:07
…d context load

- moves speculative init to speculative.cpp
- changes server_context_impl model_dft and ctx_dft to use raw pointers

- fix: don't throttle progress callback when loading draft model
- refactor: rename draft model/ctx load method
@wadealexc
wadealexc force-pushed the fix/draft-load-context branch from 0a0c16e to 7fa470e Compare July 7, 2026 13:08
@wadealexc

Copy link
Copy Markdown
Owner Author

merged: ggml-org#25056

@wadealexc wadealexc closed this Jul 7, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant