v0.1.18
v0.1.18
This is another maintenance release mainly focused on the bench
functionality
vllm
is bumped to v0.6.0 by default, harbor now also uses a version withbitsandbytes
pre-installed (runharbor build vllm
to pre-build it)bench
- judge prompt, eval log, exp. backoff for the LLM- CheeseBench is out, smells good though
Full Changelog: v0.1.17...v0.1.18