Skip to content

Commit 76e60e9

Browse files
authored
[Iluvatar][CI] fix safetensors_rust.SafetensorError: framework paddle is invalid (#4972)
1 parent 35bd2af commit 76e60e9

File tree

3 files changed

+3
-2
lines changed

3 files changed

+3
-2
lines changed

fastdeploy/model_executor/layers/moe/moe.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ def get_moe_method():
3838
return moe method based on device platform
3939
"""
4040

41-
if current_platform.is_cuda():
41+
if current_platform.is_cuda() or current_platform.is_iluvatar():
4242
from .fused_moe_cutlass_backend import CutlassMoEMethod
4343

4444
return CutlassMoEMethod(None)

requirements_iluvatar.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -39,3 +39,4 @@ opentelemetry-exporter-otlp
3939
opentelemetry-instrumentation-fastapi
4040
partial_json_parser
4141
msgspec
42+
safetensors==0.7.0rc0

tests/ci_use/iluvatar_UT/run_ernie_vl_28B.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ def target():
4242
return decorator
4343

4444

45-
@timeout(150)
45+
@timeout(180)
4646
def offline_infer_check():
4747
set_random_seed(123)
4848

0 commit comments

Comments
 (0)