Generative Scoring#34539

Merged

ywang96 merged 33 commits intovllm-project:mainfrom

vedantjh2:vjhaveri/scoring

Mar 31, 2026

Commits on Jan 30, 2026

add scoring API
vedantjh2
committed
only compute necessary tokens for scoring rather than all the tokens which made the API super slow for large batch sizes
vedantjh2
committed

Commits on Jan 31, 2026

clean up code
vedantjh2
committed

Commits on Feb 4, 2026

combine generative score API in v1/score to unify the scoring endpoint. generative used when we launch server with a *FaorCausalLM* model
vedantjh2
committed
update docs
vedantjh2
committed

Commits on Feb 6, 2026

Commits on Feb 7, 2026

Commits on Feb 13, 2026

optimize batch processing
Vedant Jhaveri
committed

Commits on Mar 17, 2026

Merge main into vjhaveri/scoring

Vedant Jhaveri
and
claude
committed

Commits on Mar 23, 2026

Move generative scoring out of pooling into standalone /generative_scores endpoint

Vedant Jhaveri
and
claude
committed
refactor generative score api
Vedant Jhaveri
committed
Merge remote-tracking branch 'upstream/main' into vjhaveri/scoring
Vedant Jhaveri
committed

Commits on Mar 24, 2026

Remove unrelated protocol.py changes
Vedant Jhaveri
committed
Code review fixes: remove dead code, fix docs, fix test paths
Vedant Jhaveri
committed

Commits on Mar 26, 2026

change name to generative_scoring
Vedant Jhaveri
committed
update docs to separate out pooling and gen scoring
Vedant Jhaveri
committed

Commits on Mar 27, 2026

Merge branch 'main' into vjhaveri/scoring
DarkLight1337
authored

Commits on Mar 28, 2026

update engine input to use renderer and lint fixes
Vedant Jhaveri
committed

Commits on Mar 30, 2026

Merge remote-tracking branch 'upstream/main' into vjhaveri/scoring
Vedant Jhaveri
committed
fix changes after integrating upstream for failing ci and testing locally
Vedant Jhaveri
committed
fix failing metadata CI
Vedant Jhaveri
committed
Fix test mocks: add renderer to mock engine, fix expected status code
Vedant Jhaveri
committed

Commits on Mar 31, 2026