perf(parser): use 8 bits for each Token flag

[overlookmotel]

Use 8 bits for each of the boolean flags in Token, so they can be read/written as bools, avoiding bitwise operations.

[overlookmotel]

• perf(parser): use 8 bits for each Token flag #11046 👈 (View in Graphite)
• refactor(parser): Token::set_has_separator take bool #11041 : 1 other dependent PR (#11042 )
• refactor(lexer): re-order Token methods #11040
• main

---

How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

• 0-merge - adds this PR to the back of the merge queue
• hotfix - for urgent hot fixes, skip the queue and merge this PR next

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

[codspeed-hq]

CodSpeed Instrumentation Performance Report

Merging #11046 will not alter performance

_{Comparing 05-14-perf_parser_use_8_bits_for_each_token_flag (80c2a5b) with main (4e5c73b)}

Summary

✅ 36 untouched benchmarks

[overlookmotel]

Small positive effect on parser benchmarks.

[Boshen]

Merge activity

• May 15, 5:29 AM EDT: The merge label '0-merge' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.
• May 15, 5:29 AM EDT: Boshen added this pull request to the Graphite merge queue.
• May 15, 5:36 AM EDT: Merged by the Graphite merge queue.