Skip to content

Comments

fix(transformer): RegExp transform only set span on final expression#5508

Merged
graphite-app[bot] merged 1 commit intomainfrom
09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression
Sep 6, 2024
Merged

fix(transformer): RegExp transform only set span on final expression#5508
graphite-app[bot] merged 1 commit intomainfrom
09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression

Conversation

@overlookmotel
Copy link
Member

@overlookmotel overlookmotel commented Sep 5, 2024

No description provided.

@github-actions github-actions bot added the A-transformer Area - Transformer / Transpiler label Sep 5, 2024
Copy link
Member Author

overlookmotel commented Sep 5, 2024

@overlookmotel overlookmotel marked this pull request as ready for review September 5, 2024 17:32
@graphite-app
Copy link
Contributor

graphite-app bot commented Sep 5, 2024

Your org has enabled the Graphite merge queue for merging into main

Add the label “0-merge” to the PR and Graphite will automatically add it to the merge queue when it’s ready to merge. Or use the label “hotfix” to add to the merge queue as a hot fix.

You must have a Graphite account and log in to Graphite in order to use the merge queue. Sign up using this link.

@codspeed-hq
Copy link

codspeed-hq bot commented Sep 5, 2024

CodSpeed Performance Report

Merging #5508 will not alter performance

Comparing 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression (9b7ecc7) with main (fad0a05)

Summary

✅ 29 untouched benchmarks

@overlookmotel
Copy link
Member Author

I think this is correct. We're transforming the whole RegExpLiteral into a NewExpression.

In: /abc/u
Out: new RegExp("abc", "u")

So I think:

  1. The entire new RegExp(...) expression should have the span of the original RegExpLiteral
  2. All the component parts (RegExp, "abc", "u") should have anonymous spans.

If I'm wrong, and we do want the component parts to have real spans, I guess they should reference the corresponding sections of the original regexp, not it's entirety.

 ___ span 1
/abc/u
     ^ span 2
            ___ span 1
new RegExp("abc", "u")
                   ^ span 2

But I'm not that knowledgeable on source maps. @Dunqing @Boshen can you please advise?

@overlookmotel
Copy link
Member Author

overlookmotel commented Sep 5, 2024

It's unclear what Babel is doing concerning spans. This doesn't set spans on inner components, but it looks like it doesn't set span on the whole expression either!

https://github.com/babel/babel/blob/main/packages/babel-plugin-transform-sticky-regex/src/index.ts

@overlookmotel overlookmotel force-pushed the 09-05-refactor_transformer_regexp_transform_unbox_early branch from aa39d3a to f716d63 Compare September 5, 2024 21:02
@overlookmotel overlookmotel force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from d1c9770 to c3d4bba Compare September 5, 2024 21:02
@overlookmotel overlookmotel force-pushed the 09-05-refactor_transformer_regexp_transform_unbox_early branch from f716d63 to 880d10f Compare September 5, 2024 21:06
@overlookmotel overlookmotel force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from c3d4bba to a57bfd3 Compare September 5, 2024 21:10
@overlookmotel overlookmotel force-pushed the 09-05-refactor_transformer_regexp_transform_unbox_early branch from 880d10f to 4b0119b Compare September 6, 2024 00:10
@overlookmotel overlookmotel force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from a57bfd3 to 90ea7b0 Compare September 6, 2024 00:10
@overlookmotel overlookmotel force-pushed the 09-05-refactor_transformer_regexp_transform_unbox_early branch from 4b0119b to 9d538fb Compare September 6, 2024 08:28
@overlookmotel overlookmotel force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from 90ea7b0 to 8ae571f Compare September 6, 2024 08:28
@overlookmotel overlookmotel force-pushed the 09-05-refactor_transformer_regexp_transform_unbox_early branch from 9d538fb to f4cb42b Compare September 6, 2024 10:04
@overlookmotel overlookmotel force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from 8ae571f to f32b4dc Compare September 6, 2024 10:04
@overlookmotel overlookmotel force-pushed the 09-05-refactor_transformer_regexp_transform_unbox_early branch from f4cb42b to 09b1265 Compare September 6, 2024 10:14
@overlookmotel overlookmotel force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from f32b4dc to 4d515cd Compare September 6, 2024 10:14
@Dunqing Dunqing added the 0-merge Merge with Graphite Merge Queue label Sep 6, 2024 — with Graphite App
@graphite-app
Copy link
Contributor

graphite-app bot commented Sep 6, 2024

Merge activity

@Dunqing Dunqing changed the base branch from 09-05-refactor_transformer_regexp_transform_unbox_early to graphite-base/5508 September 6, 2024 11:52
@Dunqing Dunqing removed the 0-merge Merge with Graphite Merge Queue label Sep 6, 2024
@Dunqing
Copy link
Member

Dunqing commented Sep 6, 2024

I'm not that knowledgeable on source maps too. I checked esbuild does. Looks like it does well. You can see the source-map-visualization

@Dunqing
Copy link
Member

Dunqing commented Sep 6, 2024

So far, I haven't checked to see if I've set the span in the transformer correctly. 😅

@Dunqing Dunqing changed the base branch from graphite-base/5508 to main September 6, 2024 12:01
@Dunqing Dunqing force-pushed the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch from 4d515cd to 9b7ecc7 Compare September 6, 2024 12:02
@graphite-app graphite-app bot merged commit 9b7ecc7 into main Sep 6, 2024
@graphite-app graphite-app bot deleted the 09-05-fix_transformer_regexp_transform_only_set_span_on_final_expression branch September 6, 2024 12:09
@Dunqing
Copy link
Member

Dunqing commented Sep 6, 2024

Once the merge label is added, no one can stop Graphite from merging PR🥲

@overlookmotel
Copy link
Member Author

You can stop it by removing the merge label if you do that before it actually starts the merge process. But once the wheels are in motion, the train has no brakes and will continue rumbling down the track no matter what you do. Choo choo!

Boshen added a commit that referenced this pull request Sep 11, 2024
## [0.28.0] - 2024-09-11

- afc4548 ast: [**BREAKING**] Educe byte size of
`TaggedTemplateExpression::quasi` by `Boxing` it (#5679) (Boshen)

- 7415e85 ast: [**BREAKING**] Reduce byte size of
`TSImportType::attributes` by `Box`ing it (#5678) (Boshen)

- ee4fb42 ast: [**BREAKING**] Reduce size of `WithClause` by `Box`ing it
(#5677) (Boshen)

- 1fa3e56 semantic: [**BREAKING**] Rename `SymbolTable::iter` to
`symbol_ids` (#5621) (overlookmotel)

- 96a1552 semantic: [**BREAKING**] Remove `SymbolTable::iter_rev`
(#5620) (overlookmotel)

- 4a8aec1 span: [**BREAKING**] Change `SourceType::js` to
`SourceType::cjs` and `SourceType::mjs` (#5606) (Boshen)

- 603817b oxc: [**BREAKING**] Add `SourceType::Unambiguous`; parse `.js`
as unambiguous (#5557) (Boshen)

- b060525 semantic: [**BREAKING**] Remove `source_type` argument from
`SemanticBuilder::new` (#5553) (Boshen)

### Features

- 2da5ad1 ast: Add `JSXElementName::get_identifier` method (#5556)
(overlookmotel)
- 2016bae coverage: Add regular expression idempotency test (#5676)
(Boshen)
- 68c3cf5 minifier: Fold `void 1` -> `void 0` (#5670) (Boshen)
- c6bbf94 minifier: Constant fold unary expression (#5669) (Boshen)
- 86256ea minifier: Constant fold `typeof` (#5666) (Boshen)
- e698418 napi/transform: Align output `SourceMap` with Rollup's
`ExistingRawSourceMap` (#5657) (Boshen)
- aba9194 napi/transform: Export react refresh options (#5533)
(underfin)
- 642295c semantic: Add `SymbolTable::delete_resolved_reference` method
(#5558) (overlookmotel)
- b3cbd56 span: `format_compact_str!` macro (#5610) (overlookmotel)
- 95a6d99 transformer: Enable the react refresh plugin in enable_all
(#5630) (Dunqing)
- 7b543df transformer/react: Handle `refresh_sig` and `refresh_reg`
options correctly (#5638) (Dunqing)
- 17226dd traverse: Add methods for deleting references (#5559)
(overlookmotel)

### Bug Fixes

- d62defb codegen: Do not print trailing commas for `ArrayExpression`
(#5551) (Boshen)
- 1bc08e2 coverage: Parse babel unambiguously (#5579) (Boshen)
- 28b934c coverage: Apply `always_strict` to test262 and typescript per
the specifcation (#5555) (Boshen)
- b9bf544 isolated-declarations: False positive for setter method in
`interface` (#5681) (Dunqing)
- 6e8409a isolated-declarations: Bindings referenced in
`TSModuleDeclaration` are removed incorrectly (#5680) (Dunqing)
- b8f8dd6 minifier/replace_global_defines: Do not replace shadowed
identifiers (#5691) (Boshen)
- 304ce25 regular_expression: Keep LegacyOctalEscape raw digits for
`to_string` (#5692) (leaysgur)
- 0511d55 regular_expression: Report more MayContainStrings error in
(nested)class (#5661) (leaysgur)
- 41582ea regular_expression: Improve RegExp `to_string()` results
(#5635) (leaysgur)
- 28aad28 regular_expression: Handle `-` in `/[\-]/u` as escaped
character (#5631) (leaysgur)
- f9e3a41 semantic: Bind `SymbolId` to function name in `if (foo)
function id() {}` (#5673) (Boshen)
- f49e6eb span: Treat `.js` as `module` file (reverts the previous
breaking change) (#5612) (Boshen)
- 919d17f transform_conformance: Only print semantic mismatch errors
when output is correct (#5589) (Boshen)
- 505d064 transformer: JSX transform delete references for
`JSXClosingElement`s (#5560) (overlookmotel)
- 9b7ecc7 transformer: RegExp transform only set span on final
expression (#5508) (overlookmotel)
- d1ece19 transformer: RegExp transform handle `Term::Quantifier`
(#5501) (overlookmotel)
- a1afd48 transformer/react: Incorrect scope_id for var hoisted in fast
refresh plugin (#5695) (Dunqing)
- f2f5e5a transformer/react: Missing scope_id for function in fast
refresh plugin (#5693) (Dunqing)
- a891c31 transformer/react: Refresh plugin has incorrect reference
flags (#5656) (Dunqing)
- 3e8b96f transformer/react: The refresh plugin cannot handle member
expressions with React hooks (#5655) (Dunqing)
- 0739b5f transformer/react: Don't transform declaration of function
overloads (#5642) (Dunqing)
- 3bf6aaf transformer/react: Support `emit_full_signatures` option in
refresh plugin (#5629) (Dunqing)
- 36d864a transformer/react: Don't transform if the variable does not
have a value reference (#5528) (Dunqing)

### Performance

- e8013d2 traverse: Faster string operations generating UIDs (#5626)
(overlookmotel)
- 4996874 traverse: `generate_uid` cache available binding names (#5611)
(overlookmotel)

### Documentation

- fefbbc1 sourcemap: Add trailing newline to README (#5539)
(overlookmotel)
- 9282647 transformer: Comment on RegExp transform for potential
improvement (#5514) (overlookmotel)
- 1c051ae traverse: Correct code comment 2 (#5607) (overlookmotel)
- 2e24a15 traverse: Correct code comment (#5604) (overlookmotel)

### Refactor

- 14ee086 ast: Inline `AstKind::as_*` methods (#5547) (overlookmotel)
- 2de6ea0 index, traverse: Remove unnecessary type annotations (#5650)
(overlookmotel)
- 0ac420d linter: Use meaningful names for diagnostic parameters (#5564)
(Don Isaac)
- 2da42ef regular_expression: Improve AST docs with refactoring
may_contain_strings (#5665) (leaysgur)
- dec1395 regular_expression: Align diagnostics (#5543) (leaysgur)
- 731ffaa semantic: Compare nodes by pointer equality (#5686)
(overlookmotel)
- 067f9b5 semantic: Introduce `IsGlobalReference` trait (#5672) (Boshen)
- d22a9b7 semantic: `SymbolTable::is_empty` use `is_empty` (#5622)
(overlookmotel)
- 3d190a5 span: Move `CompactStr` into separate file (#5609)
(overlookmotel)
- 5532628 span: Put types and impl in the same mod file (Boshen)
- ce71982 transformer: Shorten code in JSX transform (#5554)
(overlookmotel)
- 758a10c transformer: RegExp transform reuse var (#5527)
(overlookmotel)
- fad0a05 transformer: RegExp transform unbox early (#5504)
(overlookmotel)
- 19cdcc5 traverse: Revert changes to `walk.rs` (#5652) (overlookmotel)-
26d9235 Enable clippy::ref_as_ptr (#5577) (夕舞八弦)

### Styling

- e52d006 traverse: Fix formatting of traverse codegen (#5651)
(overlookmotel)
- 97e99bd traverse: Remove excess line break (#5603) (overlookmotel)-
694f032 Add trailing line breaks to `package.json` files (#5542)
(overlookmotel)

### Testing

- 2e367c9 traverse: Enable tests for `oxc_traverse` crate (#5625)
(overlookmotel)- dc92489 Add trailing line breaks to conformance
fixtures (#5541) (overlookmotel)

---------

Co-authored-by: Boshen <1430279+Boshen@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

A-transformer Area - Transformer / Transpiler

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants