Skip to content

Commit 71b812e

Browse files
Alexei-V-Ivanov-AMDMu Huai
authored and
Mu Huai
committed
FIxing the AMD test failures caused by PR#16457 (vllm-project#17511)
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com> Signed-off-by: Mu Huai <tianbowen.tbw@antgroup.com>
1 parent 18da6cc commit 71b812e

File tree

2 files changed

+1
-2
lines changed

2 files changed

+1
-2
lines changed

docker/Dockerfile.rocm

-1
Original file line numberDiff line numberDiff line change
@@ -118,4 +118,3 @@ ENV TOKENIZERS_PARALLELISM=false
118118
ENV HIP_FORCE_DEV_KERNARG=1
119119

120120
CMD ["/bin/bash"]
121-

vllm/model_executor/layers/rotary_embedding.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -80,7 +80,7 @@ def _apply_rotary_emb(x: torch.Tensor, cos: torch.Tensor, sin: torch.Tensor,
8080
is_neox_style: Whether to use the Neox-style or GPT-J-style rotary
8181
positional embeddings.
8282
"""
83-
if current_platform.is_cuda_alike():
83+
if current_platform.is_cuda():
8484
return apply_rotary_emb(x.unsqueeze(0), cos, sin,
8585
not is_neox_style).squeeze(0)
8686
else:

0 commit comments

Comments
 (0)