Skip to content

Reduce CPU-side per-token overhead in GenerateNextToken and SampleTopP - #2085

Merged
hanbitmyths merged 6 commits into
mainfrom
sunghcho/openvino_perf
Apr 20, 2026
Merged

Reduce CPU-side per-token overhead in GenerateNextToken and SampleTopP#2085
hanbitmyths merged 6 commits into
mainfrom
sunghcho/openvino_perf

Refactor InitPerTokenCache into InitializeSamplingMethod and Initiali…

054f0a6
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar