Skip to content

How can i quantize model when i use custom model on tensorrt-llm?whether i need to write c++ code or not?any examples?thank u for your time and help. #145

How can i quantize model when i use custom model on tensorrt-llm?whether i need to write c++ code or not?any examples?thank u for your time and help.

How can i quantize model when i use custom model on tensorrt-llm?whether i need to write c++ code or not?any examples?thank u for your time and help. #145

Triggered via issue January 25, 2025 14:06
Status Skipped
Total duration 2s
Artifacts

auto-assign.yml

on: issues
assign_issue
0s
assign_issue
Fit to window
Zoom out
Zoom in