Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: OpenAI Base URL supported #62

Merged
merged 8 commits into from
Nov 30, 2023
Merged

Feat: OpenAI Base URL supported #62

merged 8 commits into from
Nov 30, 2023

Conversation

Nothing1024
Copy link
Contributor

The OpenAI Base URL support has been added, and users can use the custom URL. If no input is provided, the official OpenAI URL will be used automatically.

Copy link
Contributor

sweep-ai bot commented Nov 21, 2023

Apply Sweep Rules to your PR?

  • Apply: All new business logic should have corresponding unit tests.
  • Apply: Refactor large functions to be more modular.
  • Apply: Add docstrings to all functions and file headers.

@abi
Copy link
Owner

abi commented Nov 22, 2023

thank you for this. will merge in tomorrow

@abi abi merged commit 5e6b889 into abi:main Nov 30, 2023
@abi
Copy link
Owner

abi commented Nov 30, 2023

Thanks @Nothing1024 finally merged!

@jackylee1
Copy link

The OpenAI Base URL support has been added, and users can use the custom URL. If no input is provided, the official OpenAI URL will be used automatically.

could you specify how to use it .with my local model?

@Nothing1024
Copy link
Contributor Author

The following instructions may help:

  1. Find the Web-UI container that can run your local model.
  2. Find the proxy to transform the container's API rules into OpenAI-style API rules.
  3. Change your BASE_URL.

@abi
Copy link
Owner

abi commented Jan 29, 2024

@jackylee1 you can't use it with your local model yet. This PR is about using it with a OpenAI proxy

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants