Azure Event Hub Scaler not working with Python applications

[scoser]

A clear and concise description of what the bug is.

The python Azure Event Hubs library (v 5.0.0) creates an event hub checkpoint path that is of a format that the Azure Event Hub Scaler cannot handle.

Expected Behavior

Azure Event Hub Scaler is able to retrieve the number of unprocessed messages in an Event Hub by checking the checkpoint store in a storage account.

Actual Behavior

E0413 19:29:38.343138 1 provider.go:88] keda_metrics_adapter/provider "msg"="error getting metric for scaler" "error"="unable to get checkpoint from storage: unable to download file from blob storage: -\u003e github.com/Azure/azure-storage-blob-go/azblob.newStorageError, /go/pkg/mod/github.com/!azure/[email protected]/azblob/zc_storage_error.go:42\n===== RESPONSE ERROR (ServiceCode=BlobNotFound) =====\nDescription=The specified blob does not exist.\nRequestId:055119d0-601e-0003-0fc9-1168f8000000\nTime:2020-04-13T19:29:38.3377632Z, Details: \n Code: BlobNotFound\n GET https://ephcheckpointaccdevv2.blob.core.windows.net/leases/$Default/0?timeout=61\n Authorization: REDACTED\n User-Agent: [Azure-Storage/0.7 (go1.13.3; linux)]\n X-Ms-Client-Request-Id: [368f1c4d-58a3-48d1-6bd4-5a4ff2df40d3]\n X-Ms-Date: [Mon, 13 Apr 2020 19:29:38 GMT]\n X-Ms-Version: [2018-11-09]\n --------------------------------------------------------------------------------\n RESPONSE Status: 404 The specified blob does not exist.\n Content-Length: [215]\n Content-Type: [application/xml]\n Date: [Mon, 13 Apr 2020 19:29:37 GMT]\n Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]\n X-Ms-Error-Code: [BlobNotFound]\n X-Ms-Request-Id: [055119d0-601e-0003-0fc9-1168f8000000]\n X-Ms-Version: [2018-11-09]\n\n\n" "ScaledObject.Name"="on-demand-antivirus-scaledobject-devv2" "ScaledObject.Namespace"="monitoring" "Scaler"={}

Steps to Reproduce the Problem

1. Use the python methods provided by Microsoft (https://azuresdkdocs.blob.core.windows.net/$web/python/azure-eventhub/5.0.0/azure.eventhub.aio.html#azure.eventhub.aio.EventHubConsumerClient.from_connection_string) to point an Event Hub to a storage account for checkpointing.
2. Set up a ScaledObject to point to the Event Hub and Storage Account via their connection strings.
3. See the above listed error message.

Specifications

• KEDA Version: 1.3.0
• Platform & Version: CoreOS
• Kubernetes Version: 1.15.10
• Scaler(s): Azure Event Hub

Actual details:

This is essentially the same issue as #517, but for checkpoint paths from the 5.0.0 version of the Azure Event Hub python library. The python path structure is:

://.blob.//myeventhubnamespace.servicebus.windows.net/myeventhubname//checkpoint/

(ex: https://ephcheckpointaccdevv2.blob.core.windows.net/leases/avehubnsdevv2.servicebus.windows.net/avinehubdevv2/$default/checkpoint/0)

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 7 days if no further activity occurs. Thank you for your contributions.

[stale]

This issue has been automatically closed due to inactivity.