comrak 0.45.0

[BrewTestBot]

Created by brew bump

---

Created with brew bump-formula-pr.

release notes

Welcome to v0.45.0! This is a big update, much of them part of from [rc.1 from last week](https://github.com/kivikakk/comrak/releases/tag/v0.45.0-rc.1).  More context on the size of the update in the changelog there.
The biggest library user-facing changes are ergonomic: Node<'a> instead of &'a AstNode<'a>, is nice, and so likewise node.data() instead of node.data.borrow().  They're small, but I appreciate them a lot in my own work.
You'll also notice more bovine creatures in the Comrak pasture: there's a few Cow<str> instead of String, such as in NodeValue::Text.  At most an extra .into() will be required; take note if you use any 'static str, as they'll no longer need to be heap-allocated.  Some Boxes have been added, too, to reduce the size of every NodeValue.  Let the types guide you.
Other than this, the options have been put in their own module (comrak::options), and a lot of things generally cleaned up. Read below for all the deets!  Here's the final performance comparison to v0.44.0 on aarch64:
Benchmark 1: ./bench.sh ./comrak-0.44.0
  Time (mean ± σ):      88.1 ms ±   1.9 ms    [User: 71.2 ms, System: 17.8 ms]
  Range (min … max):    86.2 ms …  93.2 ms    31 runs

Benchmark 2: ./bench.sh ./comrak-0.45.0
  Time (mean ± σ):      67.0 ms ±   1.2 ms    [User: 51.2 ms, System: 17.0 ms]
  Range (min … max):    65.2 ms …  70.0 ms    42 runs

Summary
  ./bench.sh ./comrak-0.45.0 ran
    1.32 ± 0.04 times faster than ./bench.sh ./comrak-0.44.0

Be well!
Parser changes:

Runs of more than two ~ are no longer recognised as valid delimiters, meaning they will not prevent strikethrough recognition when they occur within correct delimiters. See the PR for discussion. (by @miketheman in test: add complex tilde behavior kivikakk/comrak#635)

This does not impact spec compatibility, matches cmark-gfm, and follows the intent of the original implementation and implementor (hi!).



Changed APIs:

r#unsafe is used instead of unsafe_. (by @kivikakk in unsafe_ -> r#unsafe. kivikakk/comrak#640)
--gemojis is renamed to --gemoji. (by @kivikakk in rename --gemojis to --gemoji, include shortcodes by default in CLI, freshen --help text. kivikakk/comrak#641)
NodeValue::Text now contains a Cow<'static, str> instead of a String. This is a pretty major change, but means we can now create text nodes with static content without duplicating the string on the heap. This particularly benefits smart quotes and HTML entity resolution. (by @kivikakk in Refactor, simplify, speed up. kivikakk/comrak#627)

Adapting to this change usually means nothing on the read-only side (you can use it as a &str without issues); to write in-place, use .to_mut() on the Cow to get a &mut String. To assign, use .into() on a &str or String, like NodeValue::Text("moo".into()).
NodeValue::text() now returns a &str. It used to return a &String (!).
NodeValue::text_mut() now returns a &mut Cow<'static, str>, instead of a &mut String. This permits writing a borrowed reference.
I am experimenting with parameterising the lifetime on the Cow; it'd be amazing to refer continuously to the input where possible.


NodeValue's CodeBlock, Table, Link, Image, ShortCode and Alert variants' payloads are now boxed. (by @kivikakk in eliminate some shifts in table parser and clarify. kivikakk/comrak#632)

Adapting to this change usually means adding a Box::new call when constructing these nodes, and on matches, pulling the box out and then just dereferencing it directly (e.g. NodeValue::Table(nt) => &nt.alignments instead of NodeValue::Table(NodeTable { ref alignments }).
These payloads were larger than average, increasing the size of every node considerably. The changes reduce an Ast to 128 bytes, and a full AstNode<'_> to 176 bytes.
This produces a performance sweet spot: boxing the whole NodeValue results in worse performance than doing nothing at all. This change appreciably improves matters.
We now assert the size of a node during build to ensure future payload changes don't increase the total size of an Ast.


Options now live in comrak::options. Structs have been renamed to remove Options from their name: comrak::RenderOptions is now comrak::options::Render, etc. The old names are marked deprecated. (@kivikakk in move options into their own module. kivikakk/comrak#636)

Traits cannot be aliased yet :( URLRewriter and BrokenLinkCallback have been moved, without a deprecation period.


SyntaxHighlighterAdapter's attributes arguments now take HashMap<&'static str, Cow<'s, str>>; they used to take HashMap<String, String>. (by @kivikakk in Remove needless clones and reborrows. kivikakk/comrak#633)
html::write_opening_tag can now take different AsRef<str> types for the attribute key and value.
parse_document_with_broken_link_callback has been removed!  This entrypoint has been deprecated since 0.25.0. (by @kivikakk in Remove parse_document_with_broken_link_callback (deprecated), and move ignore_setext to parse. kivikakk/comrak#623)
options.render.ignore_setext was moved to options.parse.ignore_setext, as its effect takes place only in the parse stage. (by @kivikakk in Remove parse_document_with_broken_link_callback (deprecated), and move ignore_setext to parse. kivikakk/comrak#623)
nodes::can_contain_type is now Node::can_contain_type. (by @kivikakk in improvements from #617. kivikakk/comrak#625)

New APIs:

node.data() and node.data_mut() are added as short-hand for node.data.borrow() and node.data.borrow_mut() respectively. (by @kivikakk in add node.data() and node.data_mut() shorthand. kivikakk/comrak#643)
comrak::nodes::Node<'a> is introduced as an alias for &'a comrak::nodes::AstNode<'a>. (by @kivikakk in Refactor, simplify, speed up. kivikakk/comrak#627)
options.parse.tasklist_in_table added: parse a tasklist item if it's the only content of a table cell. (by @kivikakk in tasklist_in_table: parse a tasklist item if it's the only content of a table cell. kivikakk/comrak#622)

Performance:

Inline content is transferred to Text nodes without copying where possible. (by @kivikakk in Give last inline content to final text node. kivikakk/comrak#642).
Have you looked at your 7 year old code lately? A detail in the C-to-Rust translation meant essentially every line of input was being copied completely unnecessarily at the very beginning of the line processing stage. This no longer happens. We regret the error. (by @kivikakk in Don't copy ~every input string if we can avoid it. kivikakk/comrak#629)
Preprocess entity data at build-time so we don't spend time doing a linear search over an unsorted array, some of which we will never match. (by @kivikakk in Give content ownership to inline processor; pre-process entity data for binary search. kivikakk/comrak#631)
Inline content is consumed by the inline processor, instead of being borrowed by it and retained in memory indefinitely. (by @kivikakk in Give content ownership to inline processor; pre-process entity data for binary search. kivikakk/comrak#631)
Don't try to do better than the stdlib at guessing buffer sizes; it's very good at it. (by @kivikakk in use str internally much more. kivikakk/comrak#626)
Use str internally in block and inline processing, eliminating many UTF-8 rechecks. The strings module actually operates on strings now. (by @kivikakk in use str internally much more. kivikakk/comrak#626)
Many, many needless clones have been removed in almost every subsystem.

Dependency updates:

memchr removed from Cargo.toml; it wasn't used directly, though it still is included unconditionally due to caseless. (by @kivikakk in Use jetscii for SIMD searching. kivikakk/comrak#630)
slug is moved to a development-only dependency; it's only used in an example. (by @kivikakk in Use jetscii for SIMD searching. kivikakk/comrak#630)
jetscii is added for faster string searching, including SIMD on x86_64. (by @kivikakk in Use jetscii for SIMD searching. kivikakk/comrak#630)

I'm experimenting with aarch64 SIMD.



Documentation:

The CLI help text has been copy-edited to a consistent style. (by @kivikakk in rename --gemojis to --gemoji, include shortcodes by default in CLI, freshen --help text. kivikakk/comrak#641)
The README example code is updated to build with recent API changes. (by @kivikakk in README: sync to sample (and improve sample quality). kivikakk/comrak#621)

Build changes:

shortcodes is enabled by default (but still optional) for CLI builds. (by @kivikakk in rename --gemojis to --gemoji, include shortcodes by default in CLI, freshen --help text. kivikakk/comrak#641)
syntect is now optional (but still default) in CLI builds. (by @kivikakk in syntect optional in cli; disable syntax highlighting in bench. kivikakk/comrak#624)

Behind the scenes:

Much of the block parser code has been re-organised, and many C-isms from the original port have been refactored into readable Rust. (by @kivikakk in Refactor, simplify, speed up. kivikakk/comrak#627)
Likewise the inline parser has been re-organised. (by @kivikakk in clean up a little more. kivikakk/comrak#644)
All unsafe blocks now have a SAFETY comment describing why their actions are safe.

New Contributors

@miketheman made their first contribution in test: add complex tilde behavior kivikakk/comrak#635

Diff: kivikakk/comrak@v0.44.0...v0.45.0

View the full release notes at https://github.com/kivikakk/comrak/releases/tag/v0.45.0.

---

[github-actions]

🤖 An automated task has requested bottles to be published to this PR.

Caution

Please do not push to this PR branch before the bottle commits have been pushed, as this results in a state that is difficult to recover from. If you need to resolve a merge conflict, please use a merge commit. Do not force-push to this PR branch.