Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: 知识库QA生成,答案中有“Q”会导致提前截断。 #950

Merged
merged 1 commit into from
Mar 8, 2024

Conversation

sgdream
Copy link
Contributor

@sgdream sgdream commented Mar 7, 2024

fix: 知识库QA生成,答案中有“Q”会导致提前截断。

当前QA生成的Q格式为Q\d+,因此将匹配Q和A的正则表达式调整为 Q\d 作为判断


example:

text = 'Q1: 什么是SQL?\nA1: SQL代表结构化查询语言(Structured Query Language),它是用于管理关系型数据库系统的标准化语言。SQL允许用户执行各种任务,如从数据库中检索数据、插入新数据、更新现有数据以及删除数据。通过SQL,用户可以与数据库进行交互,并执行诸如查询、更新、插入和删除等操作。'

old: /Q\d+:(\s*)(.*)(\s*)A\d+:(\s*)([\s\S]*?)(?=Q|$)/g;

Q: 什么是SQL?
A: S

new: /Q\d+:(\s*)(.*)(\s*)A\d+:(\s*)([\s\S]*?)(?=Q\d|$)/g;

Q: 什么是SQL?
A: SQL代表结构化查询语言(Structured Query Language),它是用于管理关系型数据库系统的标准化语言。SQL允许用户执行各种任务,如从数据库中检索数据、插入新数据、更新现有数据以及删除数据。通过SQL,用户可以与数据库进行交互,并执行诸如查询、更新、插入和删除等操作。

@c121914yu
Copy link
Collaborator

感谢,没仔细考虑到这种情况

@c121914yu c121914yu merged commit 46d9a64 into labring:main Mar 8, 2024
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants