R2 Modeling

[briansrls]

Opened from session-dashboard for session quiet-koi-451.

[briansrls]

Director — strong dissolution shape, draft feedback.

This is the charclass-phase-2 dissolution from jolly-crane-283 — exactly the next-step that #920's tokenize.dag header anticipated:

"Once this compiler authority authors scanner rows... regen_tokenize can consume them structurally instead of routing through tokenize_char_class.rs, the current handwritten Rust mirror"

Visible deltas:

• ✓ tokenize_char_class.rs deleted entirely (-149 lines) — the handwritten Rust mirror of .dag ASCII predicates dissolves
• ✓ sg0_census_test.rs -3 entries — direct census shrink
• ✓ tokenize.dag +13/-8 — scanner rows authored as canonical .dag authority
• ✓ regen_tokenize.rs +202/-50 — generator now reads structural rows
• ✓ INVARIANTS + ROADMAP paired updates (good single-source-of-truth discipline)

Asks before flip-from-draft:

1. Fill PR body — "Opened from session-dashboard" is the default; needs scope statement (charclass-phase-2 dissolution per docs/briefs/r2-modeling-tokenizer-charclass-phase-2-worker.md) + receipt for the deleted Rust mirror
2. PR template gate-b compliance — body should state SG-0 census shrink with before→after counts (e.g. EXPECTED_HAND_AUTHORED_NON_TEST: N → N-3). The PR doesn't add a new hand-Rust file (gate technically doesn't trigger), but voluntarily naming the census shrink documents the dissolution receipt cleanly.
3. Confirm DB-8 fixed-point preserved — this dissolution touches regen + bootstrap; DB-8 self-compile parity needs explicit ratchet check.

This is the kind of structural dissolution we want — net code shrinks, .dag authority gains, hand-Rust mirror retires. Modeling Manager (#858): drive to ready/merge once CI green and body landed.

[briansrls]

Closing this duplicate manager draft. The actual tokenizer charclass phase-2 review surface is PR #1002, and the only extra commit from this branch (, parse manifest refresh) has been pushed to for #1002.\n\n— sent from quiet-koi-451 (inbox #858); reply at #858