Skip to content

Disable ability for OVEP to fall back to CPU inference if compilation fails for NPU #754

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 18 commits into
base: winml_factory_changes
Choose a base branch
from
Draft

Disable ability for OVEP to fall back to CPU inference if compilation fails for NPU #754

wants to merge 18 commits into from

Conversation

RyanMetcalfeInt8
Copy link

No description provided.

ankitm3k and others added 18 commits July 19, 2025 21:00
@ankitm3k
update: Implement OV Plugin using factories
caf528a
@ankitm3k
fix: refactor plugin code
b0f08cd
@ankitm3k
fix: map ep_metadata to device type using "ov_device" key
62a1612
@ankitm3k
fix: block provider options for AppendExecutionProvider_V2 pass
bbcc100
@ankitm3k
minor fix for linux
af1df0a
@RyanMetcalfeInt8 @ankitm3k
Add OrtEpLibraryOv tests
b18ffa1
@RyanMetcalfeInt8 @ankitm3k
ovep: Support multiple devices (i.e. AUTO) passed to CreateIExecution…
ce22d97 
…Provider
@RyanMetcalfeInt8 @ankitm3k
CreateIExecutionProvider: comment out unused devices parameter
ee1ecc5
@RyanMetcalfeInt8
ovep factory: Implement CreateDataTransfer to avoid crash in Register…
24aabc1 
…ExecutionProviderLibrary
@ankitm3k
update: Enable shared libs linker flags for linux & macos
9e1d62c
@RyanMetcalfeInt8
CreateIExecutionProvider: For some disallowed provider options, give …
2eefcf4 
…better guidance
@RyanMetcalfeInt8
Add PluginEp_CheckV2DisallowedProviderOptions test
43e2415
@RyanMetcalfeInt8
Merge pull request #752 from intel/rdmetca/disallowed_ep_options
cf851bf 
disallowed provider option guidance & new GTests
@RyanMetcalfeInt8
ovep: Add CreateProvider_V2 & call it from CreateIExecutionProvider
b83275a
@ankitm3k
disable data transfer for ovep
a282776
@ankitm3k
minor fix for linux
e879949
@RyanMetcalfeInt8
openvino_provider_factory: Add 'num_of_threads' to block_and_advise_e…
a38a754 
…ntries
@RyanMetcalfeInt8
OVEP: Disable ability for NPU to fall back to CPU inference for Appen…
362ef03 
…dExecutionProvider_V2 path
@RyanMetcalfeInt8 RyanMetcalfeInt8 changed the title Disable ability for OVEP to fall back to CPU inference if compilation fails for NPU WIP: Disable ability for OVEP to fall back to CPU inference if compilation fails for NPU Jul 20, 2025
@RyanMetcalfeInt8 RyanMetcalfeInt8 marked this pull request as draft July 20, 2025 20:38
@RyanMetcalfeInt8 RyanMetcalfeInt8 changed the title WIP: Disable ability for OVEP to fall back to CPU inference if compilation fails for NPU Disable ability for OVEP to fall back to CPU inference if compilation fails for NPU Jul 20, 2025
@RyanMetcalfeInt8 RyanMetcalfeInt8 mentioned this pull request Jul 20, 2025
Merged
@ankitm3k ankitm3k force-pushed the winml_factory_changes branch 4 times, most recently from 464b180 to 44d74cc Compare July 21, 2025 07:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@RyanMetcalfeInt8 @ankitm3k