server: metrics: fix bucket reset on /health, add few more metrics#5937

Merged

phymbert merged 1 commit intomasterfrom

hp/server/metrics/fix-buckets

Mar 8, 2024

Commits on Mar 8, 2024

server: metrics: add llamacpp:prompt_seconds_total and llamacpp:tokens_predicted_seconds_total, reset bucket only on /metrics. Fix values cast to int. Add Process-Start-Time-Unix header.
phymbert
committed