Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read stops after first audio chunk #13

Open
Harrolee opened this issue Apr 14, 2024 · 0 comments
Open

Read stops after first audio chunk #13

Harrolee opened this issue Apr 14, 2024 · 0 comments

Comments

@Harrolee
Copy link
Owner

BE really ought to stream audio in chunks to the FE.

Alternatively, we could send audio chunks to FE as they are generated.
FE could store all generated audio on-device.
We could track the audio chunk currently in use so that we can send its transcript to the LLM. (or maybe, if you keep using LLMs with large context windows, you can just send the entire transcript -->{even deeper, you could estimate the token count of the payload and add as much context as is possible from the transcript to it})

However you want to solve it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant