Skip to content

Commit 27a6c4a

Browse files
committed
support ray distributor executor on xpu
Signed-off-by: chzhang <[email protected]>
1 parent 509a358 commit 27a6c4a

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

examples/offline_inference/rlhf_colocate.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,6 @@ class MyLLM(LLM):
5656
def __init__(self, *args, bundle_indices: list[int], **kwargs):
5757
# Prevent Ray from manipulating the top-level CUDA_VISIBLE_DEVICES variable
5858
# so that vLLM can its own device placement inside the worker.
59-
6059
os.environ.pop("CUDA_VISIBLE_DEVICES", None)
6160
# Each worker uses 0.4 GPU so that two instances fit on the same GPUs.
6261
os.environ["VLLM_RAY_PER_WORKER_GPUS"] = "0.4"

0 commit comments

Comments
 (0)