docs(lexer): update comment to match code

[overlookmotel]

Comment describing layout of Token was out of date. Update it to correctly reflect reality.

[overlookmotel]

• docs(lexer): update comment to match code #13103 👈 (View in Graphite)
• main

---

How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

• 0-merge - adds this PR to the back of the merge queue
• hotfix - for urgent hot fixes, skip the queue and merge this PR next

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

[overlookmotel]

Only alters a comment, so skipping review.

[overlookmotel]

Merge activity

• Aug 14, 8:46 PM UTC: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.
• Aug 14, 8:46 PM UTC: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.
• Aug 14, 9:16 PM UTC: overlookmotel added this pull request to the Graphite merge queue.
• Aug 14, 9:22 PM UTC: Merged by the Graphite merge queue.

[Copilot]

Pull Request Overview

Updates documentation comments to accurately reflect the current bit layout of the Token struct. The comment was outdated and didn't match the actual implementation.

• Updated bit field descriptions to include type information and correct bit ranges
• Added documentation for unused bits (104-127)
• Corrected bit allocation for boolean fields from 1 bit to 8 bits each

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[codspeed-hq]

CodSpeed Instrumentation Performance Report

Merging #13103 will not alter performance

_{Comparing 08-14-docs_lexer_update_comment_to_match_code (56ae824) with main (7b86340)}

Summary

✅ 34 untouched benchmarks