Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor gradio tools to isolate non-gradio functions. Fix audio streaming for TTS through OpenAI. WIP for direct OpenAI nochat call without gradio. #1543

Merged
merged 50 commits into from
May 18, 2024
Merged

Refactor gradio tools to isolate non-gradio functions. Fix audio streaming for TTS through OpenAI. WIP for direct OpenAI nochat call without gradio. #1543

merged 50 commits into from
May 18, 2024

Conversation

pseudotensor
Copy link
Collaborator

@pseudotensor pseudotensor commented Apr 10, 2024 •
edited
Loading

  • Refactor gradio tools to isolate non-gradio functions.
  • Fix bug in gradio for sleep inside lock, holding lock and making things take too long and piling up till end.
  • Fix audio streaming for TTS through OpenAI. Deal with wave duration like OpenAI does.
  • WIP for direct OpenAI nochat call without gradio.

@pseudotensor
openai for submit_nochat_plain_api
d0a7fe3
@pseudotensor
more testing of openai client
b26a2f0
@pseudotensor
Fix key handling, see uvicorn workers help speed by more than 2x alre…
1443fcb 
…ady with no gradio removal
@pseudotensor
WIP separate non-gradio functions
b7c0a0e
@pseudotensor
Cosmetics
0c4a2ce
@pseudotensor
Resolve
c7dad98
@pseudotensor
Resolve
66b089c
@pseudotensor
Pass args through -- needs checking
a63fb53
@pseudotensor
0.1.0 -> 0.2.0 for docs
6d4126c
@pseudotensor
Clean-up vllm install
978fe2d
@pseudotensor
Resolve
a3ba938
@pseudotensor
Update TGI client
0e559c7
@pseudotensor
Resolve merge conflicts
e634d2f
@pseudotensor
Simplify imports
b27193c
@pseudotensor
Simplify imports
2100807
@pseudotensor
Move bot
15af4a4
@pseudotensor
More args for bot and fix get
1fe2a29
@pseudotensor
more and less prints
28087d4
@pseudotensor
more and less prints
c1b7a04
@pseudotensor
fewer prints
5892ecd
@pseudotensor
Ensure use most up to date states if going through gradio vs. non-gradio
5610326
@pseudotensor
Pass in verbose
48696c3
@pseudotensor
Protect encoding from oddities
86192c2
@pseudotensor
extra_body allowed for speech, so document
4ae3f40
@pseudotensor
Stream for real without header, when streaming
2dd5291
@pseudotensor
Fix wave truncation by player issue
79a0b37
@pseudotensor
Comment out debug
3545e8d
@pseudotensor
Fix test
1bac21a
@pseudotensor
Update test, but probably will have to relax as varies
06cac12
@pseudotensor pseudotensor changed the title openai for submit_nochat_plain_api Refactor gradio tools to isolate non-gradio functions. Fix audio streaming for TTS through OpenAI. WIP for direct OpenAI nochat call without gradio. May 17, 2024
@pseudotensor pseudotensor marked this pull request as ready for review May 18, 2024 23:17
@pseudotensor pseudotensor merged commit 6396404 into main May 18, 2024
1 of 2 checks passed
@pseudotensor pseudotensor deleted the openai_nochat branch May 18, 2024 23:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@pseudotensor