Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: Stop words input merges spaces with tokens #4088

Open
imtuyethan opened this issue Nov 21, 2024 · 0 comments
Open

bug: Stop words input merges spaces with tokens #4088

imtuyethan opened this issue Nov 21, 2024 · 0 comments
Assignees
@louis-jan
Labels
category: model settings Inference params, presets, templates type: bug Something isn't working
Milestone
v0.5.10

Comments

@imtuyethan
Copy link
Contributor

imtuyethan commented Nov 21, 2024 •
edited
Loading

Jan version

0.58-734

Describe the Bug

When entering stop words with spaces, input merges spaces into previous token instead of treating them as separate end tokens.

Screenshot 2024-11-22 at 12 03 08 AM

Steps to Reproduce

  1. Open Stop words input
  2. Enter text with spaces between tokens
  3. Observe spaces get merged with previous token
@imtuyethan imtuyethan added the type: bug Something isn't working label Nov 21, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Jan & Cortex Nov 21, 2024
@imtuyethan imtuyethan added the category: model settings Inference params, presets, templates label Nov 21, 2024
@imtuyethan imtuyethan moved this from Investigating to Scheduled in Jan & Cortex Nov 21, 2024
@imtuyethan imtuyethan added this to the v0.5.10 milestone Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@louis-jan louis-jan

Labels
category: model settings Inference params, presets, templates type: bug Something isn't working
Projects
Jan & Cortex
Status: Scheduled
Milestone
v0.5.10
Development

No branches or pull requests
2 participants
@imtuyethan @louis-jan