Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

QNN EP Sample - Fresh build with latest official QNN package produces errors on ARM64 Snapdragon QC PC #497

Open
ivberg opened this issue Nov 8, 2024 · 0 comments
Labels
QNN EP QNN EP

Comments

@ivberg
Copy link
Contributor

ivberg commented Nov 8, 2024

I used official latest ORT 1.20 pre-built package per https://onnxruntime.ai/docs/execution-providers/QNN-ExecutionProvider.html#pre-built-packages-windows-only

It looks to use QNN_2.27.0.240926142112_100894

After build and execute, some of the executions will produce error messages or crash

run_qnn_ep_sample.bat C:\Users\ivberg\Downloads\microsoft.ml.onnxruntime.qnn.1.20.0\build\native C:\Users\ivberg\Downloads\microsoft.ml.onnxruntime.qnn.1.20.0\runtimes\win-arm64\native

// Error 1

REM TODO Check for mobilenetv2-12_quant_shape.onnx_ctx.onnx

Error in cpuinfo: Unknown chip model name 'snapdragon (tm) 8cx gen 3 @ 3.40 GHz'.
Please add new Windows on Arm SoC/chip support to arm/windows/init.c!
unknown Qualcomm CPU part 0x1 ignored
...
2024-11-08 13:02:36.8328541 [E:onnxruntime:, onnx_ctx_model_helper.cc:162 onnxruntime::qnn::LoadQnnCtxFromOnnxGraph] Failed to load from EpContext model. qnn_backend_manager.cc:636 onnxruntime::qnn::QnnBackendManager::LoadCachedQnnContextFromBuffer Failed to get context binary info.
Exception in run_ort_qnn_ep: Failed to load from EpContext model. qnn_backend_manager.cc:636 onnxruntime::qnn::QnnBackendManager::LoadCachedQnnContextFromBuffer Failed to get context binary info.

// Error 2

REM run mobilenetv2-12_net_qnn_ctx.onnx (generated from native QNN) with QNN HTP backend

s:\src\onnxruntime-inference-examples\c_cxx\QNN_EP\mobilenetv2_classification\build\Release>qnn_ep_sample.exe --qnn mobilenetv2-12_net_qnn_ctx.onnx kitten_input_nhwc.raw
Exception in run_ort_qnn_ep:

The other combo of runs work fine

@vraspar vraspar added the QNN EP QNN EP label Nov 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
QNN EP QNN EP
Projects
None yet
Development

No branches or pull requests

2 participants