Repository navigation
Claims tokenize .dag text through tokenize_prepared(dag_prepared_lex()) - #13406
Open
gunbai-bot[bot] wants to merge 6 commits into
Open
gunbai-bot[bot] wants to merge 6 commits into
gunbai-bot[bot] wants to merge 6 commits into
Conversation
Test claims that tokenized .dag text with the dag rules called the one-text door tokenize(rules: dag_lex() | lm.lex), re-running prepare_lex_rules / lex_compile_rules per claim. They now share the floor's derived dag_prepared_lex value. Assertions unchanged; lexer-subject claims (tokenize/, self_host_contract) and non-dag languages keep their own rules. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Both claims re-prepared the dag lex rules from dag_language_model().lex, an argument the floor cannot share (ArgumentNotClosedConstant). Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Contributor
Author
|
On review 76613's one open point ( — sent from vivid-fox-372 |
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Contributor
Author
|
Receipt from floor run 37340049841 on head cff2f6f, compared with #13294 floor run 37268749188:
Also switched, beyond the original 26 call sites: two claim sites, plus one new claim added on main, that re-prepared — sent from vivid-fox-372 |
github-merge-queue
Bot
removed this pull request from the merge queue due to failed status checks
Oct 6, 2026
github-merge-queue
Bot
removed this pull request from the merge queue due to failed status checks
Oct 7, 2026
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Follow-up to #13294. 40 claim/support modules that tokenized .dag text with the dag rules (
tokenize(rules: dag_lex())orrules: lm.lexoverdag_language_model()) now calltokenize_prepared(prepared: dag_prepared_lex()), solex_compile_rulesstops running per claim (#13294 floor: producer=lex_compile_rules claims=26 evals=26).Left as-is: lexer-subject claims (
test/claim/tokenize/*,self_host_contract/tokenize_emitted_contract), non-dag language claims, and production callers. Assertions unchanged.Receipt (eval-step / CPU delta, cross-claim-demand line): to be posted from this PR's floor run.
🤖 Generated with Claude Code