Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
121 changes: 121 additions & 0 deletions sdk/keyvault/TROUBLESHOOTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,121 @@
# Troubleshoot Azure Key Vault Client Module Issues

The Azure Key Vault SDKs for Go use a common HTTP pipeline and authentication to create, update, and delete secrets,
keys, and certificates in Key Vault and Managed HSM. This troubleshooting guide contains steps for diagnosing issues
common to these SDKs.

## Table of Contents

* [Troubleshoot Authentication Issues](#troubleshooting-authentication-issues)
* [HTTP 401 Errors](#http-401-errors)
* [Frequent HTTP 401 Errors in Logs](#frequent-http-401-errors-in-logs)
* [Other Authentication Issues](#other-authentication-issues)
* [HTTP 403 Errors](#http-403-errors)
* [Operation Not Permitted](#operation-not-permitted)
* [Access Denied to First Party Service](#access-denied-to-first-party-service)
* [HTTP 429: Too Many Requests](#http-429-too-many-requests)
* [Other Service Errors](#other-service-errors)

## Troubleshoot Authentication Issues

### HTTP 401 Errors

HTTP 401 errors may indicate authentication problems.

#### Frequent HTTP 401 Errors in Logs

Most often, this is expected. Azure Key Vault issues a challenge for initial requests that force authentication. You
may see 401 responses in logs during application startup. If you don't see subsequent errors from the Key Vault client,
these 401 responses are the expected authentication challenges.

#### Other Authentication Issues

If you are using the `azidentity` module to authenticate Azure Key Vault clients, please see its
[troubleshooting guide](https://github.com/Azure/azure-sdk-for-go/blob/main/sdk/azidentity/TROUBLESHOOTING.md).

### HTTP 403 Errors

HTTP 403 errors indicate the user isn't authorized to perform a specific operation in Key Vault or Managed HSM.

#### Operation Not Permitted

You may see an error similar to:

```text
--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: Forbidden
--------------------------------------------------------------------------------
{
"error": {
"code": "Forbidden",
"message": "Operation decrypt is not permitted on this key.",
"innererror": {
"code": "KeyOperationForbidden"
}
}
}
```

The operation and inner `code` may vary, but the rest of the text will indicate which operation isn't permitted.
This error indicates that the authenticated application or user doesn't have permission to perform that operation.

1. Check that the application or user has the appropriate permission:
* [Access policies](https://learn.microsoft.com/azure/key-vault/general/assign-access-policy) (Key Vault)
* [Role-Based Access Control (RBAC)](https://learn.microsoft.com/azure/key-vault/general/rbac-guide) (Key Vault and Managed HSM)
2. If the appropriate permission is assigned to your application or user, make sure you are authenticating that application or user.
If using the [DefaultAzureCredential], a different credential might've been used than one you expected.
[Enable logging](https://github.com/Azure/azure-sdk-for-go/blob/main/sdk/azidentity/README.md#logging)
and you will see which credential the [DefaultAzureCredential] used as shown below, and why previously-attempted credentials
were rejected.

```text
AzureCLICredential.GetToken() acquired a token for scope https://vault.azure.net/.default
```

#### Access Denied to First Party Service

You may see an error similar to:

```text
--------------------------------------------------------------------------------
RESPONSE 403: 403 Forbidden
ERROR CODE: Forbidden
--------------------------------------------------------------------------------
{
"error": {
"code": "Forbidden",
"message": "Access denied to first party service...",
"innererror": {
"code": "AccessDenied"
}
}
}
```

The error `message` may also contain the tenant ID (`tid`) and application ID (`appid`). This error may occur because:

1. You have the **Allow trust services** option enabled and are trying to access the Key Vault from a service not on
[this list](https://learn.microsoft.com/azure/key-vault/general/overview-vnet-service-endpoints#trusted-services) of
trusted services.
2. You logged into a Microsoft Account (MSA). See [above](#operation-not-permitted) for troubleshooting steps.

### HTTP 429: Too Many Requests

If you get an error or see logs describing an HTTP 429 response, you may be making too many requests to Key Vault too quickly.

Possible solutions include:

1. Use a single instance of any client in your application for a single Key Vault.
2. Use a single credential instance for all clients.
3. Cache Key Vault resources (certificates, keys, secrets) in memory to reduce calls to retrieve them.

See the [Azure Key Vault throttling guide](https://learn.microsoft.com/azure/key-vault/general/overview-throttling)
for more information.

## Other Service Errors

To troubleshoot Key Vault errors not described in this guide,
see [Azure Key Vault REST API Error Codes](https://learn.microsoft.com/azure/key-vault/general/rest-error-codes).

[DefaultAzureCredential]: https://github.com/Azure/azure-sdk-for-go/blob/main/sdk/azidentity/README.md#defaultazurecredential
4 changes: 4 additions & 0 deletions sdk/keyvault/azcertificates/TROUBLESHOOTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Troubleshoot Azure Key Vault Certificates Client Module Issues

See our [Azure Key Vault SDK Troubleshooting Guide](https://github.com/Azure/azure-sdk-for-go/blob/main/sdk/keyvault/TROUBLESHOOTING.md)
to troubleshoot issues common to Azure Key Vault client modules.
4 changes: 4 additions & 0 deletions sdk/keyvault/azkeys/TROUBLESHOOTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Troubleshoot Azure Key Vault Keys Client Module Issues

See our [Azure Key Vault SDK Troubleshooting Guide](https://github.com/Azure/azure-sdk-for-go/blob/main/sdk/keyvault/TROUBLESHOOTING.md)
to troubleshoot issues common to Azure Key Vault client modules.
4 changes: 4 additions & 0 deletions sdk/keyvault/azsecrets/TROUBLESHOOTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Troubleshoot Azure Key Vault Secrets Client Module Issues

See our [Azure Key Vault SDK Troubleshooting Guide](https://github.com/Azure/azure-sdk-for-go/blob/main/sdk/keyvault/TROUBLESHOOTING.md)
to troubleshoot issues common to Azure Key Vault client modules.