Problem Statement
The bedrock model provider stream method uses a thread by default to make a non-blocking call to converse_stream. Use of this thread disrupts the key interrupt mechanism in agent-builder. For this particular use case, we can accept a blocking call anyway and thus I propose we make this a configurable option on the bedrock provider.
Proposed Solution
Update the bedrock model provider to accept a threaded config that will control whether converse_stream is executed on the main thread or in a separate thread.
Use Case
- Prevent interference on key interrupts in
agent-builder.
Alternatives Solutions
No response
Additional Context
No response
Problem Statement
The bedrock model provider
streammethod uses a thread by default to make a non-blocking call toconverse_stream. Use of this thread disrupts the key interrupt mechanism inagent-builder. For this particular use case, we can accept a blocking call anyway and thus I propose we make this a configurable option on the bedrock provider.Proposed Solution
Update the bedrock model provider to accept a
threadedconfig that will control whetherconverse_streamis executed on the main thread or in a separate thread.Use Case
agent-builder.Alternatives Solutions
No response
Additional Context
No response