Skip to content

Repository navigation

perf(ep): tell kernels which of their inputs ORT holds constant #1110

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
justinchuby merged 3 commits into from
Aug 17, 2026
Merged

perf(ep): tell kernels which of their inputs ORT holds constant #1110

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
e451626
perf(ep): tell kernels which of their inputs ORT holds constant
justinchuby Aug 17, 2026
0bfaad5
fix(ep): only treat constant initializers as constant weights
justinchuby Aug 17, 2026
cc873b5
refactor(ep): name the set what it holds, constant initializers
justinchuby Aug 17, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 15 additions & 0 deletions crates/onnx-runtime-ep-cpu-plugin/src/lib.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -160,6 +160,21 @@ pub extern "C" fn nxrt_ep_compiled_node_count() -> usize {
onnx_runtime_ep_plugin::ep::compiled_node_count()
}

/// Number of node inputs this EP reported to its kernels as session-lifetime
/// constants. Read through `dlopen` by the plugin E2E suite to prove weights
/// are recognised as weights on the ORT plugin path, where ORT presents a
/// fused node's initializers as ordinary inputs.
#[unsafe(no_mangle)]
pub extern "C" fn nxrt_ep_constant_weight_inputs() -> usize {
onnx_runtime_ep_plugin::ep::constant_weight_inputs()
}

/// Resets the constant-weight-input counter to zero.
#[unsafe(no_mangle)]
pub extern "C" fn nxrt_ep_reset_constant_weight_inputs() {
onnx_runtime_ep_plugin::ep::reset_constant_weight_inputs()
}

/// Resets the compiled-node counter to zero.
#[unsafe(no_mangle)]
pub extern "C" fn nxrt_ep_reset_compiled_node_count() {
Expand Down
4 changes: 4 additions & 0 deletions crates/onnx-runtime-ep-cpu-plugin/tests/plugin_export_abi.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -491,6 +491,8 @@ fn l1_required_symbols_resolve() {
&b"nxrt_ep_reset_compiled_node_count"[..],
&b"nxrt_ep_workspace_placement_queries"[..],
&b"nxrt_ep_reset_workspace_placement_queries"[..],
&b"nxrt_ep_constant_weight_inputs"[..],
&b"nxrt_ep_reset_constant_weight_inputs"[..],
] {
let _counter: libloading::Symbol<'_, unsafe extern "C" fn() -> usize> =
unsafe { lib.get(symbol) }.unwrap_or_else(|e| {
Expand Down Expand Up @@ -576,6 +578,8 @@ fn l1_no_symbol_leakage() {
&& *name != "nxrt_ep_reset_compiled_node_count"
&& *name != "nxrt_ep_workspace_placement_queries"
&& *name != "nxrt_ep_reset_workspace_placement_queries"
&& *name != "nxrt_ep_constant_weight_inputs"
&& *name != "nxrt_ep_reset_constant_weight_inputs"
&& !name.starts_with("_Z")
&& !name.starts_with("__rust")
&& !name.starts_with("__rdl_")
Expand Down
Loading
Loading