Repository navigation

Lazily initialize null_block only when it is needed - #26939

Closed

elaineyz wants to merge 7 commits into

vllm-project:mainfrom

aws-neuron:null_block

Closed

Lazily initialize null_block only when it is needed#26939
elaineyz wants to merge 7 commits into
vllm-project:mainfrom
aws-neuron:null_block

Commits on Oct 15, 2025
- lazily initialize null_block
  elaineyz
  committed
  8c96e0a
- Fix mypy
  elaineyz
  committed
  66c4d99
- clean up unused code
  elaineyz
  committed
  fbec44c
- handle an edge case where we need to allocate a null_block when no free blocks exist
  elaineyz
  committed
  71a3cf6
- bug fix
  elaineyz
  committed
  c659801
- check for _null_block in block pool before repurposing first removed block as null block
  elaineyz
  committed
  405f204
- fix indentation
  elaineyz
  committed
  d93f7ee