Skip to content

Commit

Permalink
Update readme.md
Browse files Browse the repository at this point in the history
  • Loading branch information
c0sogi authored Sep 4, 2023
1 parent 2e8cead commit 298ffd5
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -145,7 +145,6 @@ openai_replacement_models = {"gpt-3.5-turbo": "my_ggml", "gpt-4": "my_gptq2"}
```
The RoPE frequency and scaling factor will be automatically calculated and set if you don't set them in the model definition. Assuming that you are using Llama2 model.

Certainly, you can use the following Markdown template for your GitHub README to explain how to use Langchain with custom models. This guide will include information on defining the `my_model_def.py` and using it in `langchain_test.py`.

## Usage: Langchain integration

Expand Down Expand Up @@ -196,8 +195,8 @@ chat_model = ChatOpenAI(
print(chat_model.predict("hi!"))
```

Now, running the `langchain_test.py` file will make use of your custom model for completions.

Now, running the `langchain_test.py` file will make use of your custom model for completions.
Note that 'function call' feature will only work for LlamaCppModel.
That's it! You've successfully integrated a custom model into Langchain. Enjoy your enhanced text and chat completions!

## Usage: Text Completion
Expand Down

0 comments on commit 298ffd5

Please sign in to comment.