Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
64 commits
Select commit Hold shift + click to select a range
458712b
Make OpenAI API the default API
oobabooga Oct 31, 2023
5f209cb
Minor linting
oobabooga Oct 31, 2023
a1906e0
Minor changes
oobabooga Oct 31, 2023
d8ed9a0
Default parameter
oobabooga Oct 31, 2023
a8777ec
Add fastapi draft
oobabooga Oct 31, 2023
a485cf2
Add requirement
oobabooga Oct 31, 2023
277d1f6
Remove files
oobabooga Oct 31, 2023
a9e005f
Move documentation to docs/
oobabooga Oct 31, 2023
5d0a6f4
Long shot
oobabooga Oct 31, 2023
c389ef0
Revert "Long shot"
oobabooga Oct 31, 2023
e52e202
Barely functional fastapi
oobabooga Nov 1, 2023
a2b86c0
Add some typing
oobabooga Nov 1, 2023
a4a8fb7
Progress on SSE streaming
oobabooga Nov 1, 2023
96a8453
Fix streaming for real
oobabooga Nov 1, 2023
d92b725
Minor bug fix
oobabooga Nov 1, 2023
9ca5b48
Add presence/frequency penalty
oobabooga Nov 1, 2023
d1aa434
Fix a port
oobabooga Nov 1, 2023
c2fee44
Make sure that openai is the last extension
oobabooga Nov 1, 2023
2cab1bd
Add response models
oobabooga Nov 1, 2023
61f3bbb
Minor bug fix
oobabooga Nov 1, 2023
5f28082
Minor bug fix
oobabooga Nov 1, 2023
2af4058
Refactor
oobabooga Nov 1, 2023
0a91ae3
Make API functional again
oobabooga Nov 1, 2023
1e1aecf
Reorder the parameters
oobabooga Nov 2, 2023
1de74b9
Parameter defaults
oobabooga Nov 2, 2023
361c4f3
Handle truncation & instruction template
oobabooga Nov 2, 2023
2ea7ed8
Remove param
oobabooga Nov 2, 2023
d914156
Add preset support
oobabooga Nov 2, 2023
f4f7f89
Sort imports
oobabooga Nov 2, 2023
b754aa7
Merge branch 'dev' into openai-api
oobabooga Nov 3, 2023
3b2c5c0
Remove duplicate code
oobabooga Nov 3, 2023
8d15231
Add min_p
oobabooga Nov 3, 2023
738743b
Remove duplicate code
oobabooga Nov 3, 2023
c05c7cc
Use generate_chat_reply
oobabooga Nov 3, 2023
694ff93
Fix duplicate history
oobabooga Nov 3, 2023
7f6c16d
Clean up
oobabooga Nov 3, 2023
2a856ed
Merge branch 'dev' into openai-api
oobabooga Nov 4, 2023
a131b07
Add back original API with a warning
oobabooga Nov 4, 2023
9a429de
Remove default() function
oobabooga Nov 5, 2023
4cb4534
Remove the edits endpoint
oobabooga Nov 5, 2023
6a006e2
Minor change
oobabooga Nov 5, 2023
307674a
Better handle max_new_tokens
oobabooga Nov 5, 2023
b2a562a
Remove obsolete code
oobabooga Nov 5, 2023
e507221
Progress on including chat mode as an option
oobabooga Nov 5, 2023
84eb508
to_dict / to_json fix by @teddybear082
oobabooga Nov 5, 2023
d9988f8
Some bug fixes
oobabooga Nov 5, 2023
51b619a
Count the chat prompt tokens properly
oobabooga Nov 5, 2023
8c0996e
Character support
oobabooga Nov 5, 2023
764c2b3
Add "continue" support
oobabooga Nov 5, 2023
120f907
Remove unused things
oobabooga Nov 5, 2023
95eefac
Better handle exllama/llama.cpp truncation
oobabooga Nov 5, 2023
8468cfa
Better handle metadata
oobabooga Nov 5, 2023
653f3a9
Merge branch 'dev' into openai-api
oobabooga Nov 5, 2023
6752414
Add some descriptions
oobabooga Nov 6, 2023
b03afe3
Improve --public_api
oobabooga Nov 6, 2023
cfd67a3
Better handle port variable
oobabooga Nov 6, 2023
45ef68a
Update 12 - OpenAI API.md
oobabooga Nov 6, 2023
3b914dd
Merge remote-tracking branch 'refs/remotes/origin/openai-api' into op…
oobabooga Nov 6, 2023
dfe6baf
Update 12 - OpenAI API.md
oobabooga Nov 6, 2023
59692a1
Typing fixes
oobabooga Nov 6, 2023
20407bb
Add API key support
oobabooga Nov 6, 2023
1a8afaa
Better handle stopping strings
oobabooga Nov 6, 2023
9a8e92d
Clean up
oobabooga Nov 6, 2023
fd93533
Update README
oobabooga Nov 6, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ Its goal is to become the [AUTOMATIC1111/stable-diffusion-webui](https://github.
* [Custom chat characters](https://github.com/oobabooga/text-generation-webui/wiki/03-%E2%80%90-Parameters-Tab#character)
* Very efficient text streaming
* Markdown output with LaTeX rendering, to use for instance with [GALACTICA](https://github.com/paperswithcode/galai)
* API, including endpoints for websocket streaming ([see the examples](https://github.com/oobabooga/text-generation-webui/blob/main/api-examples))
* OpenAI-compatible API server

## Documentation

Expand Down Expand Up @@ -412,8 +412,8 @@ Optionally, you can use the following command-line flags:
| `--api` | Enable the API extension. |
| `--public-api` | Create a public URL for the API using Cloudfare. |
| `--public-api-id PUBLIC_API_ID` | Tunnel ID for named Cloudflare Tunnel. Use together with public-api option. |
| `--api-blocking-port BLOCKING_PORT` | The listening port for the blocking API. |
| `--api-streaming-port STREAMING_PORT` | The listening port for the streaming API. |
| `--api-port API_PORT` | The listening port for the API. |
| `--api-key API_KEY` | API authentication key. |

#### Multimodal

Expand Down
114 changes: 0 additions & 114 deletions api-examples/api-example-chat-stream.py

This file was deleted.

94 changes: 0 additions & 94 deletions api-examples/api-example-chat.py

This file was deleted.

88 changes: 0 additions & 88 deletions api-examples/api-example-stream.py

This file was deleted.

65 changes: 0 additions & 65 deletions api-examples/api-example.py

This file was deleted.

Loading