Skip to content

v0.1.18

Compare
Choose a tag to compare
@av av released this 12 Sep 16:54
· 228 commits to main since this release

v0.1.18

This is another maintenance release mainly focused on the bench functionality

  • vllm is bumped to v0.6.0 by default, harbor now also uses a version with bitsandbytes pre-installed (run harbor build vllm to pre-build it)
  • bench - judge prompt, eval log, exp. backoff for the LLM
  • CheeseBench is out, smells good though

Full Changelog: v0.1.17...v0.1.18