Commit 80e83d3
authored
[NPUW]Add MOE caching properties to NPU plugin (#34648)
### Details:
Add the following NPUW MOE-related properties to _cachingProperties:
- NPUW_MOE_TOKEN_CHUNK_SIZE
- NPUW_MOE_POOL_SIZE
- NPUW_LLM_PREFILL_MOE_HINT
- NPUW_LLM_GENERATE_MOE_HINT
These properties affect model compilation and need to be part of the
cache key.
### Tickets:
- *ticket-id*
### AI Assistance:
- *AI assistance used: no / yes*
- *If yes, summarize how AI was used and what human validation was
performed (build/tests/manual checks).*
---------
Signed-off-by: intelgaoxiong <xiong.gao@intel.com>1 parent 2ad8a3b commit 80e83d3
File tree
4 files changed
+11
-1
lines changed- src/plugins/intel_npu
- src/plugin
- include
- src
- tests/functional/internal/plugin
4 files changed
+11
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
182 | 182 | | |
183 | 183 | | |
184 | 184 | | |
| 185 | + | |
| 186 | + | |
185 | 187 | | |
186 | 188 | | |
187 | 189 | | |
| |||
211 | 213 | | |
212 | 214 | | |
213 | 215 | | |
214 | | - | |
| 216 | + | |
| 217 | + | |
| 218 | + | |
215 | 219 | | |
216 | 220 | | |
217 | 221 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
340 | 340 | | |
341 | 341 | | |
342 | 342 | | |
| 343 | + | |
| 344 | + | |
343 | 345 | | |
344 | 346 | | |
345 | 347 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
659 | 659 | | |
660 | 660 | | |
661 | 661 | | |
| 662 | + | |
| 663 | + | |
662 | 664 | | |
663 | 665 | | |
664 | 666 | | |
| |||
Lines changed: 2 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
247 | 247 | | |
248 | 248 | | |
249 | 249 | | |
| 250 | + | |
| 251 | + | |
250 | 252 | | |
251 | 253 | | |
252 | 254 | | |
| |||
0 commit comments