Skip to content

LLM-Evals now support all LangChain chatmodels
Compare
Choose a tag to compare
@penguine-ip penguine-ip released this 16 Jan 11:22
· 1949 commits to main since this release
v0.20.57
be8e95c
  • LLM-Evals (LLM evaluated metrics) now support all of langchain's chat models.
  • LLMTestCase now has execution_time and cost, useful for those looking to evaluate on these parameters
  • minimum_score is now threshold instead, meaning you can now create custom metrics that either have a "minimum" or "maximum" threshold
  • LLMEvalMetric is now GEval
  • Llamaindex Tracing integration: (https://docs.llamaindex.ai/en/stable/module_guides/observability/observability.html#deepeval)
Assets 2
Loading