XML parsing for Blob endpoint failures.

[saxenapranav]

For Blob endpoint apis, error message comes in xml format (https://learn.microsoft.com/en-us/rest/api/storageservices/status-and-error-codes2):

<?xml version="1.0" encoding="utf-8"?>  
<Error>  
  <Code>string-value</Code>  
  <Message>string-value</Message>  
</Error>

and not in JSON. This pr adds the blob endpoint error render.

---

:::: AGGREGATED TEST RESULT ::::

HNS-OAuth

[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting:181->fuzzyValidate:64 The actual value 9 is not within the expected range: [5.60, 8.40].
[ERROR] TestAbfsPerfTracker.verifyTrackingForAggregateLatencyRecords:155 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:17:03.349Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 ls=0 lc=42 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ ls=[0-9]+ lc=42 s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[ERROR] TestAbfsPerfTracker.verifyTrackingForSingletonLatencyRecords:115 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:17:06.742Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[INFO]
[ERROR] Tests run: 143, Failures: 3, Errors: 0, Skipped: 4
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:368 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 793, Failures: 0, Errors: 1, Skipped: 197
[INFO] Results:
[INFO]
[WARNING] Tests run: 284, Failures: 0, Errors: 0, Skipped: 49

HNS-SharedKey

[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsPerfTracker.verifyTrackingForAggregateLatencyRecords:155 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:25:44.793Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 ls=0 lc=42 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ ls=[0-9]+ lc=42 s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[ERROR] TestAbfsPerfTracker.verifyTrackingForSingletonLatencyRecords:115 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:25:48.145Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[INFO]
[ERROR] Tests run: 143, Failures: 2, Errors: 0, Skipped: 4
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:371 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 793, Failures: 0, Errors: 1, Skipped: 197
[INFO] Results:
[INFO]
[WARNING] Tests run: 284, Failures: 0, Errors: 0, Skipped: 49

NonHNS-SharedKey

[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsPerfTracker.verifyTrackingForAggregateLatencyRecords:155 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:34:15.510Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 ls=0 lc=42 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ ls=[0-9]+ lc=42 s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[ERROR] TestAbfsPerfTracker.verifyTrackingForSingletonLatencyRecords:115 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:34:18.777Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[INFO]
[ERROR] Tests run: 143, Failures: 2, Errors: 0, Skipped: 4
[INFO] Results:
[INFO]
[WARNING] Tests run: 793, Failures: 0, Errors: 0, Skipped: 275
[INFO] Results:
[INFO]
[WARNING] Tests run: 284, Failures: 0, Errors: 0, Skipped: 45

NonHNS-OAuth

[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsClientThrottlingAnalyzer.testManySuccessAndErrorsAndWaiting:181->fuzzyValidate:64 The actual value 18 is not within the expected range: [5.60, 8.40].
[ERROR] TestAbfsPerfTracker.verifyTrackingForAggregateLatencyRecords:155 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:44:49.977Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 ls=0 lc=42 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ ls=[0-9]+ lc=42 s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[ERROR] TestAbfsPerfTracker.verifyTrackingForSingletonLatencyRecords:115 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:44:53.633Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[INFO]
[ERROR] Tests run: 143, Failures: 3, Errors: 0, Skipped: 4
[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] ITestAzureBlobFileSystemRandomRead.testValidateSeekBounds:276->Assert.assertTrue:42->Assert.fail:89 There should not be any network I/O (elapsedTimeMs=38).
[INFO]
[ERROR] Tests run: 793, Failures: 1, Errors: 0, Skipped: 275
[INFO] Results:
[INFO]
[WARNING] Tests run: 284, Failures: 0, Errors: 0, Skipped: 45

AppendBlob-HNS-OAuth

[INFO] Results:
[INFO]
[ERROR] Failures:
[ERROR] TestAbfsPerfTracker.verifyTrackingForAggregateLatencyRecords:155 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:55:20.570Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 ls=0 lc=42 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ ls=[0-9]+ lc=42 s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[ERROR] TestAbfsPerfTracker.verifyTrackingForSingletonLatencyRecords:115 [Latency record should be in the correct format]
Expecting:
"h=hadoop-vm-east2.internal.cloudapp.net t=2023-08-14T05:55:25.331Z a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=0 s=0 e= ci=null ri= ct=0 st=0 rt=0 bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
to contain pattern:
"h=[^ ]* t=[^ ]* a=bogusFilesystemName c=bogusAccountName cr=oneOperationCaller ce=oneOperationCallee r=Succeeded l=[0-9]+ s=0 e= ci=[^ ]* ri=[^ ]* bs=0 br=0 m=GET u=http%3A%2F%2Fwww.microsoft.com%2FbogusFile"
[INFO]
[ERROR] Tests run: 143, Failures: 2, Errors: 0, Skipped: 4
[INFO] Results:
[INFO]
[ERROR] Errors:
[ERROR] ITestAzureBlobFileSystemLease.testAcquireRetry:383 » TestTimedOut test timed o...
[INFO]
[ERROR] Tests run: 793, Failures: 0, Errors: 1, Skipped: 197
[INFO] Results:
[INFO]
[WARNING] Tests run: 284, Failures: 0, Errors: 0, Skipped: 49

Time taken: 47 mins 24 secs.

azureuser@Hadoop-VM-EAST2:~/hadoop/hadoop-tools/hadoop-azure$
azureuser@Hadoop-VM-EAST2:~/hadoop/hadoop-tools/hadoop-azure$ git log
commit ea0dfb49333c7c73db080ac5c8253fadfe34c4ae (HEAD -> ABFS_3.3.2_dev_errorMsg, origin/ABFS_3.3.2_dev_errorMsg)
Author: Pranav Saxena <>
Date:   Sun Aug 13 22:12:24 2023 -0700

    added test for dfs errorStream parsing

The only errors in the run are for verifyTrackingForAggregateLatencyRecords. This is failing on ABFS_3.3.2_dev at this instance. Getting fixed as part of https://github.com/ABFSDriver/AbfsHadoop/pull/96/files.