Skip to content

feat: openai oss attention sink support with trtllm-gen backend#8825

Closed
yyihuang wants to merge 5 commits intosgl-project:oss-oaifrom
yyihuang:attn-sink
Closed

feat: openai oss attention sink support with trtllm-gen backend#8825
yyihuang wants to merge 5 commits intosgl-project:oss-oaifrom
yyihuang:attn-sink