Code

Added settings vllm#2599

Code

Merged

merrymercy merged 10 commits intolm-sys:mainlm-sys/FastChat:mainfrom SebastianBodza:added_SettingsVLLMSebastianBodza/FastChat_addout:added_SettingsVLLMCopy head branch name to clipboardNov 1, 2023

+36

Commits

Commits on Oct 17, 2023

• Added top_k & penaltys

  

  bodza

  committed
  8e35481

  Copy full SHA for 8e35481

• Fixed top_k definition

  

  bodza

  committed
  3b9bbbb

  Copy full SHA for 3b9bbbb

• Added top_k to completion request

  

  bodza

  committed
  27fad0d

  Copy full SHA for 27fad0d

• typo ,

  

  bodza

  committed
  e119ca9

  Copy full SHA for e119ca9

• Fixed 2nd typo smh

  

  bodza

  committed
  ae6eed7

  Copy full SHA for ae6eed7

• added topk to ChatCompletionRequest

  

  bodza

  committed
  7d9c46b

  Copy full SHA for 7d9c46b

• Added top_p to @app.post("/v1/chat/completions", dependencies=[Depends(check_api_key)])

  

  bodza

  committed
  8bed52f

  Copy full SHA for 8bed52f

Commits on Oct 24, 2023

• ran format.sh

  

  bodza

  committed
  09fa806

  Copy full SHA for 09fa806

• Defaults from vllm

  

  bodza

  committed
  43423eb

  Copy full SHA for 43423eb

• Merge branch 'main' into added_SettingsVLLM

  SebastianBodza

  authored
  06f9ff1

  Copy full SHA for 06f9ff1