Skip to content

Commit 7c83c84

Browse files
chaojun-zhanggooglercolin
authored andcommitted
[XPU] Conditionally import CUDA-specific passes to avoid import errors on xpu platform (vllm-project#21036)
Signed-off-by: chzhang <[email protected]>
1 parent 28fe92f commit 7c83c84

File tree

1 file changed

+6
-3
lines changed

1 file changed

+6
-3
lines changed

vllm/compilation/pass_manager.py

Lines changed: 6 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,12 +5,15 @@
55

66
from vllm.config import VllmConfig
77
from vllm.logger import init_logger
8+
from vllm.platforms import current_platform
9+
10+
if current_platform.is_cuda_alike():
11+
from .fusion import FusionPass
12+
from .collective_fusion import AllReduceFusionPass, AsyncTPPass
13+
from .fusion_attn import AttnFusionPass
814

915
from .activation_quant_fusion import ActivationQuantFusionPass
10-
from .collective_fusion import AllReduceFusionPass, AsyncTPPass
1116
from .fix_functionalization import FixFunctionalizationPass
12-
from .fusion import FusionPass
13-
from .fusion_attn import AttnFusionPass
1417
from .inductor_pass import CustomGraphPass, InductorPass, get_pass_context
1518
from .noop_elimination import NoOpEliminationPass
1619
from .sequence_parallelism import SequenceParallelismPass

0 commit comments

Comments
 (0)