DxDispatch issue with QCOM NPU on Windows

[mram0509]

Using NPU driver version 30.0.32.1000 ( 10/9/2024).

The devices are listed as below:
dxdispatch.exe -s

Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Adreno(TM) GPU
.....
.....
Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Hexagon(TM) NPU
.....
.....
Microsoft Basic Render Driver
.....
.....

Using with GPU - outputs GPU duration
dxdispatch.exe modelname.onnx -a "Qualcomm(R) Adreno(TM) GPU" -i 50
Running on 'Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Adreno(TM) GPU'
.....
.....
Dispatch 'modelname.onnx': 50 iterations, 3.3328 ms median (CPU), 3.048333 ms median (GPU)

Using with NPU does not show NPU duration - Outputs nan
dxdispatch.exe modelname.onnx -a "Qualcomm(R) Hexagon(TM) NPU" -i 50
Running on 'Snapdragon(R) X Elite - X1E80100 - Qualcomm(R) Hexagon(TM) NPU'
.....
.....
Dispatch 'modelname.onnx': 50 iterations, 6.3512 ms median (CPU), nan ms median (GPU)

[ashumish-QCOM]

Hi @mram0509

Based on the details provided, it seems that the Qualcomm Hexagon NPU is not returning valid timing information, resulting in nan values. Here are a few steps to help diagnose and potentially resolve this issue:

Driver Verification: Ensure that you are using the latest NPU driver version 30.0.32.1000 (10/9/2024). If not, please update to the latest version.
Model Compatibility: Verify that the model modelname.onnx is compatible with the Qualcomm Hexagon NPU. Some models may require specific optimizations.