Repository navigation

[Rust Frontend] Add /tokenize and /detokenize endpoints - #44222

Merged

BugenZhao merged 17 commits into

vllm-project:mainfrom

TanNgocDo:tando-feat/rust-tokenize-detokenize

Jun 9, 2026

Merged

[Rust Frontend] Add /tokenize and /detokenize endpoints#44222
BugenZhao merged 17 commits into
vllm-project:mainfrom
TanNgocDo:tando-feat/rust-tokenize-detokenize

Commits on Jun 1, 2026
- [Frontend][Rust] Add /tokenize and /detokenize endpoints to the Rust server
  
  TanNgocDo
  and
  claude
  committed
  e918a14
Commits on Jun 5, 2026
- Update rust/src/server/src/routes/openai/chat_completions/convert.rs
  
  TanNgocDo
  and
  BugenZhao
  authored
  8747a89
- Update rust/src/server/src/routes/openai/chat_completions/convert.rs
  
  TanNgocDo
  and
  BugenZhao
  authored
  43a151b
- Merge branch 'main' into tando-feat/rust-tokenize-detokenize
  TanNgocDo
  authored
  de0f688
- [Rust Frontend] Validate tokenize chat messages like chat completions
  TanNgocDo
  committed
  728d29c
- Use openAI tool
  TanNgocDo
  committed
  2e55d3e
- remove redundant token_id log
  TanNgocDo
  committed
  dee11ba
- Merge branch 'main' into tando-feat/rust-tokenize-detokenize
  TanNgocDo
  authored
  8242a24
Commits on Jun 7, 2026
- Merge branch 'main' into tando-feat/rust-tokenize-detokenize
  TanNgocDo
  authored
  88ed1e8
- Merge branch 'main' into tando-feat/rust-tokenize-detokenize
  TanNgocDo
  authored
  d698787
Commits on Jun 8, 2026
Commits on Jun 9, 2026