feat: repetition detector for degenerate token loops#65

janhilgard wants to merge 1 commit intowaybarrios:mainwaybarrios/vllm-mlx:mainfrom

janhilgard:feature/repetition-detectorjanhilgard/vllm-mlx:feature/repetition-detectorCopy head branch name to clipboard