Skip to content

Commit a55c950

Browse files
authored
Correctly kill vLLM processes after finishing serving benchmarks (#21641)
Signed-off-by: Huy Do <[email protected]>
1 parent 97349fe commit a55c950

File tree

1 file changed

+8
-6
lines changed

1 file changed

+8
-6
lines changed

.buildkite/nightly-benchmarks/scripts/run-nightly-benchmarks.sh

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -95,12 +95,14 @@ json2args() {
9595
}
9696

9797
kill_gpu_processes() {
98-
pkill -f python
99-
pkill -f python3
100-
pkill -f tritonserver
101-
pkill -f pt_main_thread
102-
pkill -f text-generation
103-
pkill -f lmdeploy
98+
pkill -f '[p]ython'
99+
pkill -f '[p]ython3'
100+
pkill -f '[t]ritonserver'
101+
pkill -f '[p]t_main_thread'
102+
pkill -f '[t]ext-generation'
103+
pkill -f '[l]mdeploy'
104+
# vLLM now names the process with VLLM prefix after https://github.com/vllm-project/vllm/pull/21445
105+
pkill -f '[V]LLM'
104106

105107
while [ "$(nvidia-smi --query-gpu=memory.used --format=csv,noheader,nounits | head -n 1)" -ge 1000 ]; do
106108
sleep 1

0 commit comments

Comments
 (0)