Support for tools/function calling. #115
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
This is more or less ready to go from our side. |
ggozad
added
enhancement
…to infer whether the tool is asyncronous or not
ggozad
changed the title
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Tools
Tools are special "functions" that can provide external information to the LLM model that it does not otherwise have access to.
The following tools are currently supported:
date_time- provides the current date and time in ISO format.current_location- provides the current location of the user (longitude, latitude, city, region, country). Uses ipinfo.io to determine the location.current_weather- provides the current weather in the user's location. Uses OpenWeatherMap to determine the weather.shell- allows you to run shell commands and use the output as input to the model. Obviously this can be dangerous, so use with caution.Note that tools integration is experimental and may change in the future. I particularly welcome contributions for new tools, bear in mind that any additional requirements in terms of dependencies or paid-for API usage should be kept to a minimum.