-
Notifications
You must be signed in to change notification settings - Fork 225
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve AWS bedrock integration #289
base: main
Are you sure you want to change the base?
Improve AWS bedrock integration #289
Conversation
was literally about to make a PR to fix the list model method. Looks like you beat me to it. |
@ajithvcoder Hi, are you able to adapt this to work with this new PR for streaming in bedrock and also have no merge conflicts ? |
@ajithvcoder the tests i wrote in #314 are an adaptation of yours. So it should just work with your code. |
…for aws bedrock integration
0ba9498
to
8ef0893
Compare
@fm1320 the merge conflicts are fixed and #314 is already working fine as @lloydhamilton told. |
What does this PR do?
aws_profile_name
andaws_region_name
list_models()
and added support to pass arguments for specific model fetchingconvert_inputs_to_api_kwargs()
to acceptmodel
asmodelId
andmax_tokens
asmaxTokens
internallyinferenceConfig
andadditionalModelRequestFields
aws_bedrock.rst
file for documentationtutorials\bedrock_client_simple_qa.py
for showing usage exampletutorials\generator_all_providers.py
Fixes #283
Before submitting
Was this discussed/agreed via a GitHub issue? (not for typos and docs)
Did you read the contributor guideline? yes
Did you make sure your PR does only one thing, instead of bundling different changes together?
Did you make sure to update the documentation with your changes? (if necessary) Yes
Did you write any new necessary tests? (not for typos and docs) Yes i have added mock tests and
tutorials\bedrock_client_simple_qa.py
Did you verify new and existing tests pass locally with your changes? Yes
Did you list all the breaking changes introduced by this pull request? There is no breaking changes