Share kv-cache in multimethod pte #17496
Description
To reduce runtime memory when we have a multimethod PTE file, have each method point to the same kv-cache.
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Status
{{ message }}
To reduce runtime memory when we have a multimethod PTE file, have each method point to the same kv-cache.
Status