Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve post-processing of text #63

Open
miltondp opened this issue Oct 23, 2024 · 1 comment
Open

Improve post-processing of text #63

miltondp opened this issue Oct 23, 2024 · 1 comment
Assignees

Comments

@miltondp
Copy link
Collaborator

We are using Manubot AI Editor on the review article we are working on. There are many of these post-editing issues, when we take the response from the model and convert it into a one-sentence-per-line format. It fails to capture sentences' ends.

Image
(from here)

@vincerubinetti vincerubinetti self-assigned this Dec 18, 2024
@vincerubinetti
Copy link
Collaborator

To start, let's try just asking the LLMs to separate one line per sentence. I'll at least informally test adding this instruction to prompts with chat GPT on some common exceptions that might throw off sentence delimitation: initials, decimal numbers, ellipsis, abbreviations

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants