Skip to content

feat(napi/oxlint): read source text into start of allocator#12122

Merged
graphite-app[bot] merged 1 commit intomainfrom
07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator
Jul 9, 2025
Merged

feat(napi/oxlint): read source text into start of allocator#12122
graphite-app[bot] merged 1 commit intomainfrom
07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator

Conversation

@overlookmotel
Copy link
Member

@overlookmotel overlookmotel commented Jul 7, 2025

In napi/oxlint2, read source text into start of allocator, instead of end. This is what raw transfer needs.

The implementation here is a complete dog's dinner! In order to inject this code into oxlint library code without affecting the behavior of existing oxlint app, it uses oxlint2 feature to changes the allocator's behavior.

There is also way too much unsafe code for comfort. Much of the code in this PR can be removed again when we replace bumpalo with our own allocator, because that allocator will allocate all strings at start of the arena by default anyway.

So I propose that we accept this mess as a temporary solution just to get us to a working prototype, and then clean it up in next couple of weeks.

Copy link
Member Author

overlookmotel commented Jul 7, 2025


How to use the Graphite Merge Queue

Add either label to this PR to merge it via the merge queue:

  • 0-merge - adds this PR to the back of the merge queue
  • hotfix - for urgent hot fixes, skip the queue and merge this PR next

You must have a Graphite account in order to use the merge queue. Sign up using this link.

An organization admin has enabled the Graphite Merge Queue in this repository.

Please do not merge from GitHub as this will restart CI on PRs being processed by the merge queue.

This stack of pull requests is managed by Graphite. Learn more about stacking.

@codspeed-hq
Copy link

codspeed-hq bot commented Jul 7, 2025

CodSpeed Instrumentation Performance Report

Merging #12122 will not alter performance

Comparing 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator (152e59d) with main (729b82b)

Summary

✅ 34 untouched benchmarks

@overlookmotel overlookmotel force-pushed the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch from 47026ff to b12e85e Compare July 7, 2025 18:02
@overlookmotel overlookmotel force-pushed the 07-04-feat_allocator_add_allocator_set_data_ptr_method branch from e40153a to 78cf55f Compare July 7, 2025 18:02
@overlookmotel overlookmotel changed the base branch from 07-04-feat_allocator_add_allocator_set_data_ptr_method to graphite-base/12122 July 8, 2025 21:50
@overlookmotel overlookmotel force-pushed the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch from b12e85e to e7d7ff7 Compare July 8, 2025 22:24
@overlookmotel overlookmotel force-pushed the graphite-base/12122 branch from 78cf55f to 6d5588c Compare July 8, 2025 22:24
@overlookmotel overlookmotel changed the base branch from graphite-base/12122 to 07-04-feat_allocator_add_allocator_set_data_ptr_method July 8, 2025 22:24
@overlookmotel overlookmotel force-pushed the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch from e7d7ff7 to 312d645 Compare July 8, 2025 22:31
@overlookmotel overlookmotel marked this pull request as ready for review July 8, 2025 22:39
@overlookmotel overlookmotel requested a review from camc314 as a code owner July 8, 2025 22:39
@overlookmotel
Copy link
Member Author

The tests added in #12149 still pass after this change, so it doesn't seem to have broken anything.

@graphite-app graphite-app bot changed the base branch from 07-04-feat_allocator_add_allocator_set_data_ptr_method to graphite-base/12122 July 9, 2025 08:58
@graphite-app graphite-app bot force-pushed the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch from 312d645 to d1871fd Compare July 9, 2025 09:07
@graphite-app graphite-app bot force-pushed the graphite-base/12122 branch from 6d5588c to 8d710a2 Compare July 9, 2025 09:07
@graphite-app graphite-app bot changed the base branch from graphite-base/12122 to main July 9, 2025 09:08
@graphite-app graphite-app bot force-pushed the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch from d1871fd to ebf648e Compare July 9, 2025 09:08
@camc314 camc314 added the 0-merge Merge with Graphite Merge Queue label Jul 9, 2025
Copy link
Contributor

camc314 commented Jul 9, 2025

Merge activity

In `napi/oxlint2`, read source text into start of allocator, instead of end. This is what raw transfer needs.

The implementation here is a complete dog's dinner! In order to inject this code into `oxlint` library code without affecting the behavior of existing `oxlint` app, it uses `oxlint2` feature to changes the allocator's behavior.

There is also way too much unsafe code for comfort. Much of the code in this PR can be removed again when we replace `bumpalo` with our own allocator, because that allocator will allocate all strings at start of the arena by default anyway.

So I propose that we accept this mess as a temporary solution just to get us to a working prototype, and then clean it up in next couple of weeks.
@graphite-app graphite-app bot force-pushed the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch from ebf648e to 152e59d Compare July 9, 2025 09:53
@graphite-app graphite-app bot merged commit 152e59d into main Jul 9, 2025
26 checks passed
@graphite-app graphite-app bot deleted the 07-07-feat_napi_oxlint_read_source_text_into_start_of_allocator branch July 9, 2025 10:01
@graphite-app graphite-app bot removed the 0-merge Merge with Graphite Merge Queue label Jul 9, 2025
graphite-app bot pushed a commit that referenced this pull request Jul 9, 2025
Big endian tests were failing on CI. This is due to a strange combination of cargo features getting enabled in the tests, causing problems in linter crates, since #12122.

I don't entirely understand how this was happening, but running the tests with `cross test --all-features` fixes it. In any case, we do want to run tests for all features on big endian.
This was referenced Jul 12, 2025
camc314 added a commit that referenced this pull request Jul 16, 2025
## [1.7.0] - 2025-07-16

### 🚀 Features

- 5e428a4 linter/eslint-plugin-next: No-html-link-for-pages rule
addition (#12194) (Gabriel Díaz Aguilera)
- 9b14fbc ast: Add `ThisExpression` to `TSTypeName` (#12156) (Boshen)
- c551b8f linter: Report diagnostics from custom plugins (#12219)
(camc314)
- d387729 linter: JS custom rules config (#12160) (camc314)
- 152e59d napi/oxlint: Read source text into start of allocator (#12122)
(overlookmotel)
- bde1ef1 linter: Load custom JS plugins (#11980) (camc314)
- d4ebd14 linter: Add `oxlint2`/`disable_oxlint2` feature flags (#12130)
(camc314)
- a4dae73 linter: Introduce `LintPlugins` to store builtin + custom
plugins (#12117) (camc314)

### 🐛 Bug Fixes

- 3f9a1f0 linter/no-unused-private-class-members: Fix false positive
with nullish coalescing assignments (#12317) (camc314)
- 47fad0e linter/no-empty-file: False positive with empty file with
triple slash directive (#12293) (camc314)
- 633ba30 linter: False positive with unknown plugins when unmatched
eslint rule (#12285) (camc314)
- 9720774 linter: Report implicit config parse errors (#12260) (Simon
Buchan)
- 1920c6b language_server: Respect the root `.oxlintrc.json` file for
`ignorePatterns` (#12171) (Sysix)
- 98708eb linter: Fix inconsistent behavior in `no-duplicate-imports`
rule (#12192) (yefan)
- 853d2bc linter, language_server: Correctly identify usage of `import`
plugin (#12157) (overlookmotel)

### 🚜 Refactor

- ee761de ast: Remove `AstKind` for `AssignmentTarget` (#12252) (Tyler
Earls)
- c68b607 ast: Rename `TemplateLiteral::quasi` to
`TemplateLiteral::single_quasi` (#12266) (Dunqing)
- 32c32af ast: Check whether there is a single `quasi` in
`TemplateLiteral::quasi` (#12265) (Dunqing)
- 8f6a1da linter/js-plugins: Use `u32` for IDs (#12243) (overlookmotel)
- 36cd364 linter/js-plugins: Clean up code (#12242) (overlookmotel)
- 8c02ebd linter/js-plugins: Rename `specifiers` to `paths` (#12241)
(overlookmotel)
- 3adaf98 linter: Simplify getting nodes count (#12239) (overlookmotel)
- 6e54645 language_server: Store `LintService` instead of `Linter`
(#12016) (Sysix)
- 113cf8c linter: Move `LintServiceOptions.paths` to
`LintService.with_paths` (#12015) (Sysix)
- acfac68 oxlint: Adjust ignore patterns by counting bytes instead of
chars (#12209) (Sysix)
- 729b82b linter: Rename `plugin_name` to `plugin_specifier` (#12148)
(overlookmotel)
- 532b816 linter: Use `to_string` instead of `into` (#12147)
(overlookmotel)
- 89f2a69 linter: TODO comment (#12146) (overlookmotel)
- f90d3e1 linter: Feature gate `load_external_plugin` by both `oxlint2`
and `disable_oxlint2` features (#12141) (overlookmotel)
- 12e4ec7 linter: Make `tokio` dependency optional (#12140)
(overlookmotel)
- 1d2eaca oxlint2: Introduce `force_test_reporter` feature for
consistent graphical outputs (#12133) (camc314)
- 8814c53 ast: Remove `AstKind` for `PropertyKey` (#12108) (camchenry)
- 228cff5 semantic,linter: Assert that Program is always the first node
(#12123) (Ulrich Stark)
- e8e2a25 ast: Remove `AstKind` for `AssignmentTargetPattern` (#12105)
(camchenry)
- f7c675d linter: Rename `LintPlugins` to `BuiltinLintPlugins` (#12116)
(camc314)
- a9e5ec0 linter: Access plugins through config instead of storing
directly (#12115) (camc314)
- 9736a7f linter: Simplify `unicorn/require-post-message-target-origin`
(#12110) (shulaoda)

### 📚 Documentation

- 2e3db46 linter: Add missing backtick preventing website from building
(#12113) (camc314)

### ⚡ Performance

- d0f8b88 linter/js-plugins: Do not copy `Vec` (#12248) (overlookmotel)
- 4284d19 linter/js-plugins: Use hashmap `Entry` API + remove temp `Vec`
(#12247) (overlookmotel)
- c7889c3 semantic,linter: Simplify implementation and uses of ancestors
iterators (#12164) (Ulrich Stark)
- f99959c linter: Move work out of loop (#12145) (overlookmotel)
- 514d40c linter: Do not create `Resolver` unless required (#12142)
(overlookmotel)
- 7103527 linter/no-constructor-return: Optimize loop (#12138)
(overlookmotel)

### 🧪 Testing

- d1194e8 oxlint: Ignore test on windows (#12262) (camc314)

Co-authored-by: camc314 <18101008+camc314@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-cli Area - CLI C-enhancement Category - New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants