Call bedrock model with my own hostUrl

[Nirnea]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

import { ChatBedrockConverse } from '@langchain/aws';
import { HumanMessage } from '@langchain/core/messages';

const model = new ChatBedrockConverse({
  region: process.env.BEDROCK_AWS_REGION ?? 'us-east-1',
  endpointHost: 'https://llmgw-test.blindspot.dev/aws-bedrock',
  credentials: {
    secretAccessKey: 'my_access_key',
    accessKeyId: 'my_access_key_id',
  },
  model: 'amazon.titan-text-express-v1',
});

const messages = [new HumanMessage('test message')];
const response = await model.invoke(messages);

console.log(response);

Description

I am trying to call aws model that is on my custom endpoint url endpointHost: 'https://llmgw-test.blindspot.dev/aws-bedrock'
This works correctly with python langchain.

Current behavior: It seems that the request is targeted to aws bedrock directly instead of to my host endpoint, as shown in the attached screenshot.

Therefore, I get error UnrecognizedClientException: The security token included in the request is invalid.

Expected behavior: Obtain llm response upon invoke.

System Info

node version: v22.9.0
platform: mac
dependencies:
{
"dependencies": {
"@langchain/aws": "^0.1.5",
"@langchain/core": "^0.3.41",
"@langchain/openai": "^0.4.4",
}
}

[dosubot[bot]]

Hello, @Nirnea! I'm here to assist you with any bugs, questions, or contributions you may have. Let's tackle this issue together!

To ensure that the ChatBedrockConverse model in TypeScript uses your custom endpoint URL, you should verify that the endpointHost property is correctly set in your configuration. Your code snippet seems correct in setting the endpointHost to your custom URL. However, if the request is still being sent to AWS Bedrock directly, there might be an issue with how the endpointHost is being handled internally.

Here are a few things you can check or try:

1. Ensure Correct Property Usage: Double-check that the endpointHost property is being used correctly in the ChatBedrockConverse class. According to the documentation, endpointHost should override the default endpoint hostname ^[1].

2. Check for Overrides: Ensure there are no other parts of your code or configuration that might override the endpointHost setting after it's initially set.

3. Debugging: Use logging or debugging to confirm that the endpointHost is set to your custom URL before the request is made. This can help identify if the value is being changed unexpectedly.

4. Library Version: Make sure you are using the latest version of the @langchain/aws package, as there might have been updates or bug fixes related to this functionality.

5. Credentials: The error message UnrecognizedClientException: The security token included in the request is invalid. suggests there might be an issue with the credentials. Ensure that the credentials are correct and have the necessary permissions for your custom endpoint.

If these steps do not resolve the issue, it might be helpful to look into the internal implementation of the ChatBedrockConverse class to ensure that the endpointHost is being utilized as expected.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}