You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
String with non-alphanumeric formatted content which has a next-char of an alpha-numeric is tokenized as text node, instead of into a series of format nodes as expected.
Problem reproduced on CommonMark online demo (to reproduce just paste **@**A there and compare with **@** A).
Example:
While all these samples are tokenize as expected:
Are you claiming that the parser doesn't properly implement the spec, or are you suggesting a change to the spec? If the latter, please examine the current rules and be specific about the change you'd recommend, recognizing that any change that "fixes" this case may break other things.
Unfortunately, the way commonmark / Markdown is designed, it is difficult to avoid some "blind spots" like this. See my essay Beyond Markdown, item 1. My project https://djot.net attempts to fix some of these issues.
String with non-alphanumeric formatted content which has a next-char of an alpha-numeric is tokenized as
text
node, instead of into a series of format nodes as expected.Problem reproduced on CommonMark online demo (to reproduce just paste
**@**A
there and compare with**@** A
).Example:
While all these samples are tokenize as expected:
This sample will be tokenized into a
text
node and will not be parsed:**@**A
(formatted non-alphanumeric + alphanumeric)Add a space between formatted non-alphanumeric and alpha-numeric and compare tokenization for string
**A** @
:The text was updated successfully, but these errors were encountered: