Skip to content

Commit 403a4a9

Browse files
dongxuy04liji-nv
andauthored
Apply suggestions from code review
Accept suggestions from liji. Co-authored-by: Jin Li <[email protected]> Signed-off-by: dongxuy04 <[email protected]>
1 parent c9360c9 commit 403a4a9

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

cpp/tensorrt_llm/thop/moeCommOp.cpp

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -242,7 +242,7 @@ TORCH_LIBRARY_IMPL(trtllm, CUDA, m)
242242

243243
TORCH_LIBRARY_FRAGMENT(trtllm, m)
244244
{
245-
m.def("moe_initialize_workspace(Tensor all_workspaces, int ep_rank, int ep_size) -> ()");
245+
m.def("moe_initialize_workspace(Tensor(a!) all_workspaces, int ep_rank, int ep_size) -> ()");
246246
}
247247

248248
TORCH_LIBRARY_IMPL(trtllm, CUDA, m)
@@ -286,7 +286,7 @@ TORCH_LIBRARY_IMPL(trtllm, CUDA, m)
286286
TORCH_LIBRARY_FRAGMENT(trtllm, m)
287287
{
288288
m.def(
289-
"memset_expert_ids(Tensor experts_ids, Tensor recv_rank_count_cumsum, int max_token_count_per_rank, int top_k, "
289+
"memset_expert_ids(Tensor(a!) experts_ids, Tensor recv_rank_count_cumsum, int max_token_count_per_rank, int top_k, "
290290
"int slot_count, int ep_size) -> ()");
291291
}
292292

0 commit comments

Comments
 (0)