Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -126,13 +126,13 @@ provider-comparison cohort.
| Paged decode MHA | B1, KV 1, NHD, D128 | 9.54 µs | 13.77 µs | Oxide 1.44× |
| Ragged prefill MHA | Q 16, KV 16, D128 | 8.25 µs | 13.99 µs | Oxide 1.69× |
| Ragged prefill GQA4 | Q 32+64, KV 256+1024, D128 | 36.94 µs | 21.93 µs | FlashInfer 1.68× |
| Paged prefill GQA4 | Q 32+64, KV 256+1024, D128 | 57.60 µs | 23.35 µs | FlashInfer 2.47× |
| Paged prefill GQA4 | Q 32+64, KV 256+1024, D128 | 46.60 µs | 23.21 µs | FlashInfer 2.01× |

These are CUDA-event measurements of matched operator paths, not isolated
kernel, model, or serving results. See the [complete record and raw
samples](docs/results/h20-flashinfer-v0.6.17-attention-eager-performance-7f3d08e-20260812.json).
The [optimized paged-GQA4 record](docs/results/h20-flashinfer-v0.6.17-paged-prefill-tiled-gqa4-eager-performance-49290b5-20260812.json)
contains its source-bound two-order samples and before/after comparison.
The [current paged-GQA4 record](docs/results/h20-flashinfer-v0.6.17-paged-prefill-current-gqa4-eager-performance-02faf27-20260812.json)
contains separate two-order provider and source-progression cohorts.
The [optimized ragged-GQA4 record](docs/results/h20-flashinfer-v0.6.17-ragged-prefill-dual-tile-gqa4-eager-performance-f9b95b0-20260812.json)
does the same for the dual-tile path.

Expand Down
10 changes: 6 additions & 4 deletions docs/flashinfer-parity.md
Original file line number Diff line number Diff line change
Expand Up @@ -134,10 +134,12 @@ pinned FlashInfer release. It retains both provider orders and 2,800 raw
latency samples. Oxide has lower combined median eager latency in eight stable
shapes and FlashInfer in six.

The [optimized paged-GQA4 record](results/h20-flashinfer-v0.6.17-paged-prefill-tiled-gqa4-eager-performance-49290b5-20260812.json)
supersedes only the long paged-GQA4 row. It binds the tiled split-four source,
both provider orders, paged and ragged correctness and Graph gates, and all
four sanitizer tools for both exact runners.
The [current paged-GQA4 record](results/h20-flashinfer-v0.6.17-paged-prefill-current-gqa4-eager-performance-02faf27-20260812.json)
supersedes only the long paged-GQA4 row. It keeps provider and source
progression in separate two-order cohorts and binds raw samples, exact runner
and artifact hashes, correctness and Graph gates, and all four sanitizer tools.
The earlier [paged optimization record](results/h20-flashinfer-v0.6.17-paged-prefill-tiled-gqa4-eager-performance-49290b5-20260812.json)
remains its immutable precursor.

The [optimized ragged-GQA4 record](results/h20-flashinfer-v0.6.17-ragged-prefill-dual-tile-gqa4-eager-performance-f9b95b0-20260812.json)
supersedes only the long ragged-GQA4 row. It binds the dual-tile source and
Expand Down
12 changes: 10 additions & 2 deletions docs/results/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,14 @@ valid-output paged-decode Graph, and all GPUs other than the recorded H20.

## Current-source R2 matched performance

- [Current long paged-GQA4 eager performance against FlashInfer 0.6.17](h20-flashinfer-v0.6.17-paged-prefill-current-gqa4-eager-performance-02faf27-20260812.json)
binds source `02faf27`, source `49290b5` as a separate progression cohort,
exact runner and artifact hashes, 400 raw samples, correctness, valid-output
and rejection Graph replay, and all four Compute Sanitizer tools. In the
provider cohort, Oxide measures 46.60 microseconds and FlashInfer 23.21
microseconds, a 2.01x gap. In the source cohort, current Oxide is 18.45%
lower latency than `49290b5`.

- [Optimized long ragged-GQA4 eager performance against FlashInfer 0.6.17](h20-flashinfer-v0.6.17-ragged-prefill-dual-tile-gqa4-eager-performance-f9b95b0-20260812.json)
binds clean source `f9b95b0`, its source-bound parent, exact matched and gate
runner hashes, both provider orders, 400 raw latency samples, correctness,
Expand All @@ -92,12 +100,12 @@ valid-output paged-decode Graph, and all GPUs other than the recorded H20.
record retains per-order summaries but not raw samples; it supports the
conservative stop decision, not a complete performance qualification.

- [Optimized long paged-GQA4 eager performance against FlashInfer 0.6.17](h20-flashinfer-v0.6.17-paged-prefill-tiled-gqa4-eager-performance-49290b5-20260812.json)
- [First optimized long paged-GQA4 eager performance against FlashInfer 0.6.17](h20-flashinfer-v0.6.17-paged-prefill-tiled-gqa4-eager-performance-49290b5-20260812.json)
binds clean source `49290b5`, exact paged and ragged tiled-GQA4 runners, both
provider orders, correctness and Graph limits, and all four Compute
Sanitizer tools. Oxide moves from 265.66 to 57.60 microseconds on the recorded
shape, a 4.61x speedup. FlashInfer remains lower at 23.35 microseconds, a
2.47x gap.
2.47x gap. The current paged record above supersedes this exact row.

- [Matched BF16 attention eager-provider performance against FlashInfer 0.6.17](h20-flashinfer-v0.6.17-attention-eager-performance-7f3d08e-20260812.json)
binds the unchanged product source at merged commit `7f3d08e`, the exact
Expand Down
Loading