You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Based on the discussion here, I'd like to be able to cancel the llm request from the function filter (ideally using a cancellation token).
I can see two solutions that make sense here.
1.) The cancellation token from the originating HttpRequest is passed through the context as a new property.
2.) The "Result" property cancels the originating request when it is a Task or IAsyncEnumerable that has been cancelled.
The text was updated successfully, but these errors were encountered:
Based on the discussion here, I'd like to be able to cancel the llm request from the function filter (ideally using a cancellation token).
I can see two solutions that make sense here.
1.) The cancellation token from the originating HttpRequest is passed through the context as a new property.
2.) The "Result" property cancels the originating request when it is a Task or IAsyncEnumerable that has been cancelled.
The text was updated successfully, but these errors were encountered: