perf(plugin): stop routing host intermediates through ORT scratch, and recycle them by justinchuby · Pull Request #1073 · justinchuby/onnx-genai

perf(cpu): dense fast path for broadcasting Add/Sub/Mul/Div

justinchuby

and

Copilot

committed

52e3025

Merge remote-tracking branch 'origin/main' into deckard/dense-binary-broadcast

justinchuby

committed

6719fe9

test(cpu): pin dense-Add dispatch on the predicate, not a global counter

justinchuby

and

Copilot

committed

a268e01

Merge remote-tracking branch 'origin/main' into deckard/dense-binary-broadcast

justinchuby

committed

5ef749e

perf(cpu): stage f16/bf16 binary elementwise through bulk f32 conversion

justinchuby

and

Copilot

committed

22ff128

Merge remote-tracking branch 'origin/main' into deckard/f16-binary-elementwise

justinchuby

committed

6fd9012

Correct HALF_STAGE_CHUNK staging-buffer doc comment

justinchuby

and

Copilot

committed

b4e8c3d

Merge remote-tracking branch 'origin/deckard/f16-binary-elementwise' into deckard/f16-contrib-assignment

justinchuby

committed

b0fd8a0

Allocate routed-subgraph host intermediates off the Rust allocator and recycle them

justinchuby

and

Copilot

committed

99bd4de

Poison recycled intermediates in debug builds, and prove reuse end to end

justinchuby

and

Copilot

committed

080dfb9

Merge remote-tracking branch 'origin/main' into deckard/f16-contrib-assignment

justinchuby

committed

7ae60da

Navigation Menu

Repository navigation

perf(plugin): stop routing host intermediates through ORT scratch, and recycle them - #1073

perf(plugin): stop routing host intermediates through ORT scratch, and recycle them#1073
justinchuby merged 11 commits into
mainfrom
deckard/f16-contrib-assignment

Commits on Aug 16, 2026

perf(cpu): dense fast path for broadcasting Add/Sub/Mul/Div

Merge remote-tracking branch 'origin/main' into deckard/dense-binary-broadcast

test(cpu): pin dense-Add dispatch on the predicate, not a global counter

Merge remote-tracking branch 'origin/main' into deckard/dense-binary-broadcast

perf(cpu): stage f16/bf16 binary elementwise through bulk f32 conversion

Merge remote-tracking branch 'origin/main' into deckard/f16-binary-elementwise

Correct HALF_STAGE_CHUNK staging-buffer doc comment

Merge remote-tracking branch 'origin/deckard/f16-binary-elementwise' into deckard/f16-contrib-assignment

Allocate routed-subgraph host intermediates off the Rust allocator and recycle them

Poison recycled intermediates in debug builds, and prove reuse end to end

Merge remote-tracking branch 'origin/main' into deckard/f16-contrib-assignment