Skip to content

Commit 75e101e

Browse files
committed
Add log message
Signed-off-by: Iman Tabrizian <[email protected]>
1 parent 390553d commit 75e101e

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

cpp/tensorrt_llm/thop/allreduceOp.cpp

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -163,6 +163,8 @@ class AllreduceOp
163163
{
164164
size_t size = input.numel();
165165
size_t seq_len = input.size(0);
166+
size_t bytes_per_element = input.element_size();
167+
TLLM_LOG_DEBUG("All reduce message size is %zu", size * bytes_per_element);
166168

167169
if (std::getenv("TLLM_USE_NCCL_UB") && mStrategy == AllReduceStrategyType::UB)
168170
{

0 commit comments

Comments
 (0)