Skip to content

Add enable_weightless property #32345

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 11 commits into from
Oct 27, 2025
Merged

Add enable_weightless property #32345

merged 11 commits into from
Oct 27, 2025

Conversation

@olpipi
Copy link
Contributor

@olpipi olpipi commented Oct 9, 2025 •
edited by praasz
Loading

Details:

  • Add ENABLE_WEIGHTLESS propert.
  • Use this property in CPU, GPU plugin. It is possible to create weightless blob when ENABLE_WEIGHTLESS is turned on and cache mode is set to OPTIMIZE_SPEE
  • Update tests
  • Add common helpers to check config if Weightless is configured and add WL hint getter from config.

Related PRs:

Tickets:

@olpipi olpipi requested a review from a team as a code owner October 9, 2025 10:49
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: CPP API OpenVINO CPP API bindings labels Oct 9, 2025
@olpipi olpipi force-pushed the weightless_properties branch from 17a0875 to f87c97d Compare October 9, 2025 11:03
@olpipi olpipi force-pushed the weightless_properties branch from f87c97d to d28c01a Compare October 16, 2025 13:15
@olpipi olpipi requested review from a team as code owners October 16, 2025 13:15
@github-actions github-actions bot added category: GPU OpenVINO GPU plugin category: CPU OpenVINO CPU plugin labels Oct 16, 2025
@moslex moslex added this to the 2025.4 milestone Oct 22, 2025
@praasz
Move WL utils for config
90da1ba 
- update plugins
- add tests for ENABLE_WEIGHTLESS in CPU plugin

Signed-off-by: Pawel Raasz <[email protected]>
@praasz praasz requested review from a team as code owners October 23, 2025 10:01
@github-actions github-actions bot added the category: IE Tests OpenVINO Test: plugins and common label Oct 23, 2025
tkrupa-intel
tkrupa-intel approved these changes Oct 24, 2025
View reviewed changes
Copy link
Contributor

@tkrupa-intel tkrupa-intel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good from GPU perspective.
I suggest also adding the property to the Python API (src/bindings/python/src/pyopenvino/core/properties/properties.cpp, src/bindings/python/src/openvino/_pyopenvino/properties/__init__.py).

nshchego
nshchego reviewed Oct 24, 2025
View reviewed changes
src/inference/dev_api/openvino/runtime/weightless_properties_utils.hpp
* @param config Input configuration to examine.
* @return std::nullopt If input configuration doesn't define to enable/disable weightless blob.
* @return true If ENABLE_WEIGHTLESS:true
* @return true If no ENABLE_WEIGHTLESS and CACHE_MODE:OPTIMIZE_SIZE
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is not it quite complicated for users? In particular, in the CPU plugin these options do the same things. Can we remove the CACHE_MODE at least?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not doing the same. by default cache mode enable/disable WL blob
but is not possible to make WL blob for mode is speed or disable when cache mode is size

@praasz praasz requested a review from a team as a code owner October 24, 2025 12:03
@github-actions github-actions bot added the category: Python API OpenVINO Python bindings label Oct 24, 2025
@smirnov-alexey smirnov-alexey mentioned this pull request Oct 26, 2025
Merged
@praasz praasz requested a review from nshchego October 26, 2025 20:49
@mlukasze mlukasze added this pull request to the merge queue Oct 27, 2025
@moslex moslex added the priority: high High piority label Oct 27, 2025
Merged via the queue into openvinotoolkit:master with commit 5a87a6d Oct 27, 2025
225 of 227 checks passed
github-merge-queue bot pushed a commit that referenced this pull request Oct 28, 2025
@smirnov-alexey
[NPUW] Support enable_weightless property (#32555)
0d9a56c 
Depends on #32345
CVS-169440
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@praasz praasz praasz left review comments

@t-jankowski t-jankowski t-jankowski approved these changes

@tkrupa-intel tkrupa-intel tkrupa-intel approved these changes

@razvanapetroaie razvanapetroaie razvanapetroaie approved these changes

@nshchego nshchego Awaiting requested review from nshchego

Assignees

@PatrikStepan PatrikStepan

@nshchego nshchego

@tkrupa-intel tkrupa-intel

@praasz praasz

@razvanapetroaie razvanapetroaie

Labels

category: CPP API OpenVINO CPP API bindings category: CPU OpenVINO CPU plugin category: GPU OpenVINO GPU plugin category: IE Tests OpenVINO Test: plugins and common category: inference OpenVINO Runtime library - Inference category: Python API OpenVINO Python bindings Code Freeze priority: high High piority

Projects

None yet

Milestone

2025.4

Development

Successfully merging this pull request may close these issues.

9 participants

@olpipi @nshchego @t-jankowski @tkrupa-intel @praasz @razvanapetroaie @PatrikStepan @moslex @mlukasze