proxy: fix metrics for non-llama.cpp backends (vLLM) and correct wall-clock timing#701
Closed
efschu wants to merge 2 commits into
Closed
proxy: fix metrics for non-llama.cpp backends (vLLM) and correct wall-clock timing#701efschu wants to merge 2 commits into
efschu wants to merge 2 commits into
