Skip to content

Commit 886fcbd

Browse files
strgrbZhang Kaihong
andauthored
Use apply_rope_with_cos_sin_cache_inplace for DeepSeek (#4764)
Co-authored-by: Zhang Kaihong <[email protected]>
1 parent 8bf6d7f commit 886fcbd

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

python/sglang/srt/layers/rotary_embedding.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -645,7 +645,7 @@ def _compute_cos_sin_cache(self) -> torch.Tensor:
645645
cache = torch.cat((cos, sin), dim=-1)
646646
return cache
647647

648-
def forward(
648+
def forward_native(
649649
self,
650650
positions: torch.Tensor,
651651
query: torch.Tensor,

0 commit comments

Comments
 (0)