Skip to content

Commit 41c675c

Browse files
committed
refactor: Remove Request class and update decoder request handling
- Deleted the Request class from the runtime module, simplifying the codebase and reducing dependencies. - Updated functions in CreateNewDecoderRequests to directly utilize LlmRequest, enhancing clarity and maintainability. - Adjusted function signatures to accommodate the removal of the Request class, ensuring seamless integration with existing logic. Signed-off-by: Robin Kobus <[email protected]>
1 parent 223e41e commit 41c675c

File tree

2 files changed

+106
-159
lines changed

2 files changed

+106
-159
lines changed

cpp/include/tensorrt_llm/runtime/request.h

Lines changed: 0 additions & 47 deletions
This file was deleted.

0 commit comments

Comments
 (0)