Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why is the streaming parameter of the TTS interface set to True, which actually returns all fragments instead of streaming #819

Open
6 tasks done
Rosejacka opened this issue Jan 13, 2025 · 5 comments
Labels
bug Something isn't working

Comments

@Rosejacka
Copy link

Self Checks

  • This template is only for bug reports. For questions, please visit Discussions.
  • I have thoroughly reviewed the project documentation (installation, training, inference) but couldn't find information to solve my problem. English 中文 日本語 Portuguese (Brazil)
  • I have searched for existing issues, including closed ones. Search issues
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template and fill in all required fields.

Cloud or Self Hosted

Self Hosted (Source)

Environment Details

linux

Steps to Reproduce

Why is the streaming parameter of the TTS interface set to True, which actually returns all fragments instead of streaming
image

✔️ Expected Behavior

Why is the streaming parameter of the TTS interface set to True, which actually returns all fragments instead of streaming

❌ Actual Behavior

Why is the streaming parameter of the TTS interface set to True, which actually returns all fragments instead of streaming

@Rosejacka Rosejacka added the bug Something isn't working label Jan 13, 2025
@Haoran1272
Copy link

This "streaming:true" means: generating a file that can be streamed, rather than streaming the file back to you. you can transfer this file to your client in a streamed format. At least that's how I understand it.

@Rosejacka
Copy link
Author

In that case, wouldn't it be a fake stream? If we stream the file output, the response will be greatly improved

@Haoran1272
Copy link

I don't know how to access the real stream, I split an article into several paragraphs according to punctuation, and start streaming when the first text is generated, and dynamically append the other paragraphs to the first audio after completion, so it won't wait long even if the article is very long.

@Rosejacka
Copy link
Author

I did the same thing, splitting sentences and cloning in batches, but I am working on a low latency real-time interaction example. If I could do true streaming, the experience would be faster

@Haoran1272
Copy link

yes, there must be some way, let me know if you find it, please

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants