Commit 5e3c1ed
authored
[Version] Bump version to 0.2.31 (#362)
### Changes
- Enable `webllm.AppConfig.useIndexedDBCache` so that user can choose
between the Cache API and IndexedDB Cache
- #352
- Refactor `ChatModule` to `Engine`, finalize OpenAI API to
`engine.chat.completions.create()` to match that of OpenAI
- #361
- Add deprecation warning of `engine.generate()`, suggesting user to use
`engine.chat.completions.create()`
- Subsequently, support implicit KVCache reuse for multi-round chat
usage
- Though `chat.completions.create()` is functional, hence requiring
users to maintain all chat history, we will reuse KVs if we detect
multi-round chat, hence not sacrificing any performance
- See #359 and
`examples/multi-round-chat`
### WASM Version
WASMs are still `v0_2_30` as no compile-time changes are required.
### tvmjs
Updated tvmjs to:
-
mlc-ai/relax@c7bdcab
- i.e.
apache/tvm@d1e24ca1 parent 16d5e00 commit 5e3c1ed
File tree
16 files changed
+17
-17
lines changed- examples
- cache-usage
- chrome-extension-webgpu-service-worker
- chrome-extension
- function-calling
- get-started-web-worker
- get-started
- json-mode
- logit-processor
- multi-round-chat
- next-simple-chat
- seed-to-reproduce
- simple-chat
- streaming
- utils/vram_requirements
16 files changed
+17
-17
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
15 | 15 | | |
16 | 16 | | |
17 | 17 | | |
18 | | - | |
| 18 | + | |
19 | 19 | | |
20 | 20 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
9 | 9 | | |
10 | 10 | | |
11 | 11 | | |
12 | | - | |
| 12 | + | |
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| |||
0 commit comments