Fixes streaming for anthropic tool call.

[3coins]

Fixes #80
Replaces #81

[pratik60]

Any timelines on when we could merge this? The pr looks good to me, and the problem is blocking usage of Bedrock sonnet on our end.

[xAlstrat]

Just tried it in langgraph, but I had to adjust a little bit how to use it.

Here are the docs. I'm not sure if part of this PR or not. But I thought it would work seamlessly, and it didn't.

https://langchain-ai.github.io/langgraph/how-tos/streaming-tokens/#streaming-llm-tokens

langgraph==0.1.14
sonnet3.5 through Bedrock

[Bagel213]

Just ran into this same problem with Claude using ChatBedrock, good to see it close to being corrected! Thanks!

[ccurme]

@3coins what work remains on this? Can we push it through?

[Bagel213]

I am still getting the same error using ChatBedrock with streaming=True.

File "/home/ec2-user/miniconda3/envs/intrepid/lib/python3.11/site-packages/langchain_aws/llms/bedrock.py", line 594, in _get_provider
if self.model_id.startswith("arn"):
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RecursionError: maximum recursion depth exceeded while calling a Python object

It works without issue with streaming not set.

[ccurme]

I am still getting the same error using ChatBedrock with streaming=True.

File "/home/ec2-user/miniconda3/envs/intrepid/lib/python3.11/site-packages/langchain_aws/llms/bedrock.py", line 594, in _get_provider if self.model_id.startswith("arn"): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ RecursionError: maximum recursion depth exceeded while calling a Python object

It works without issue with streaming not set.

Could you try again? This wasn't released at the time of your comment. Just released in langchain-aws==0.1.14.

[Bagel213]

Got it working with out the error.......realized I updated langchain and not langchain-aws. User error!