config async problem when creating endpoint

[RwGrid]

Describe the bug

when i remove the async 'AsyncInferenceConfig' , it works, but i want an async endpoint because my payload is above 5 mb, its a numpy array of image of 50 + mb , so i need async, the container is triton

Expected Behavior

create an endpoint

Current Behavior

botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the CreateEndpoint operation: One or more endpoint features are not supported using this configuration

Reproduction Steps

create_model = sagemaker_client.create_model(
ModelName = 'tritoninferencesasync',
ExecutionRoleArn = role,
PrimaryContainer= container)

create_endpoint_config_response = sm_client.create_endpoint_config(
EndpointConfigName='endpointconfigsingleasnyc',
ProductionVariants=[
{
"VariantName": "variant1",
"ModelName": 'tritoninferencesasync',
"InstanceType": "ml.m5.xlarge",
"InitialInstanceCount": 1,
}
],
AsyncInferenceConfig={
"OutputConfig": {
"S3OutputPath": "s3://allinferences/yy/xx"
},
"ClientConfig": {"MaxConcurrentInvocationsPerInstance": 4},
},
)
endpoint_name='tritonendpointsasync'
create_multi_endpoint = sagemaker_client.create_endpoint(
EndpointName = endpoint_name,
EndpointConfigName = 'endpointconfigsingleasnyc')

Possible Solution

another region maybe >? > currently in milan

Additional Information/Context

No response

SDK version used

boto3==1.35.11 botocore==1.35.11

Environment details (OS name and version, etc.)

windows 11

[tim-finnigan]

Thanks for reaching out. The create_model command makes a request to the CreateModel API, so the ValidationError is coming from the SageMaker service API. Have you tried testing in other regions? I found a report of this same error, where someone commented about how the region could be the issue. (Although the SageMaker documentation says that Milan should be supported.)

I also noticed that you have both sagemaker_client and sm_client, so wanted to check if you intended to have separate clients here. If still seeing an issue, please share debug logs (with any sensitive info redacted) by adding boto3.set_stream_logger('') to your script.