Repository navigation

(refactor caching) use LLMCachingHandler for caching streaming responses - #6210

Merged

ishaan-jaff merged 12 commits into

mainfrom

litellm_refactor_streaming_caching

Oct 14, 2024

Merged

(refactor caching) use LLMCachingHandler for caching streaming responses #6210
ishaan-jaff merged 12 commits into
mainfrom
litellm_refactor_streaming_caching

Commits on Oct 14, 2024
- use folder for caching
  ishaan-jaff
  committed
  73df98a
- fix importing caching
  ishaan-jaff
  committed
  e29f461
- fix clickhouse pyright
  ishaan-jaff
  committed
  77d9f38
- fix linting
  ishaan-jaff
  committed
  0a26ce6
- fix correctly pass kwargs and args
  ishaan-jaff
  committed
  805d4b9
- fix test case for embedding
  ishaan-jaff
  committed
  296538f
- fix linting
  ishaan-jaff
  committed
  e83a088
- fix embedding caching logic
  ishaan-jaff
  committed
  201f834
- fix refactor handle utils.py
  ishaan-jaff
  committed
  bf0582e
- refactor async set stream cache
  ishaan-jaff
  committed
  e3a654d
- fix linting
  ishaan-jaff
  committed
  cf42432
- Merge branch 'main' into litellm_refactor_streaming_caching
  ishaan-jaff
  committed
  49d251c