RESPONSE Status: 500 Operation could not be completed within the specified time

[g-spencer]

Which version of the AzCopy was used? 10.26.0

Note: The version is visible when running AzCopy without any argument

Which platform are you using? (ex: Windows, Mac, Linux) Windows server 2019

What command did you run? azcopy_windows_amd64_10.26.0\AzCopy.exe copy --cap-mbps=10 --log-level=ERROR "abcd-conflu-dks-ws08_osdisk-202408151005.vhd" "https://md-impexp-wrvqjsfmgsqh.z38.blob.storage.azure.net/jsqrl0txdd43/abcd?REDACTED" --blob-type PageBlob

Note: Please remove the SAS to avoid exposing your credentials. If you cannot remember the exact command, please retrieve it from the beginning of the log file.

What problem was encountered? RESPONSE Status: 500 Operation could not be completed within the specified time

This repeats until the expiry after one hour.

How can we reproduce the problem in the simplest way? I am following this MS procedure: https://learn.microsoft.com/en-us/azure/virtual-machines/linux/disks-upload-vhd-to-managed-disk-cli

trying to upload a disk previously downloaded to local storage, basically trying to reverse the operation where we downloaded the disk: https://learn.microsoft.com/en-us/azure/virtual-machines/linux/download-vhd?tabs=azure-portal

Have you found a mitigation/solution? No, I logged a ticket with MS/Mindtree, but they are having difficulty finding an SME.

I attach the log file here [I've had several goes at this, it's persistent]
a058c44b-3ce1-d046-6845-56ea339a55a3.zip

[souravgupta-msft]

Hi @g-spencer. The PutPage operation is timing out, hence you are seeing the 500 error OperationTimedOut. Kindly ask the support engineer assigned to the ticket to reach out to the backend team as to why the request is timing out.

[souravgupta-msft]

In your copy command, can you remove the flag --cap-mbps=10 and retry the operation

[g-spencer]

Hi,

we are a 24/7 operation, I had previously tried this disk copy operation using storage explorer, but unfortunately this grabs all bandwidth, this caused a p1 for the company I work for.

I cannot remove the cap-mbps flag from azcopy, that is why I looked at azcopy instead of storage explorer.

If I were to remove the cap, I suspect my employment would be terminated if I let azcopy also run unrestricted.

[souravgupta-msft]

You can reach out to the backend team then as this is a server-side timeout error.

I cannot remove the cap-mbps flag from azcopy, that is why I looked at azcopy instead of storage explorer.

Can you try setting this to some higher value?

[g-spencer]

I can try, but I probably won't be able to get permission to do that until next week, after my boss returns from leave. In the meantime, if you can get your backend team to investigate it will be appreciated. Thanks, Gary Spencer | Infrastructure Engineer Tel: +44 1908 865223 | Mob: +44 7703 607442 2 Whitehall Avenue, Kingston, Milton Keynes, MK10 0AX ***@***.***<https://www.sis.tv/> My working day may look different to yours. I do not expect you to read, respond or action this email outside of your normal working hours. From: Sourav Gupta ***@***.***> Sent: 27 August 2024 13:26 To: Azure/azure-storage-azcopy ***@***.***> Cc: Gary Spencer ***@***.***>; Mention ***@***.***> Subject: Re: [Azure/azure-storage-azcopy] RESPONSE Status: 500 Operation could not be completed within the specified time (Issue #2788) You can reach out to the backend team then as this is a server-side timeout error. I cannot remove the cap-mbps flag from azcopy, that is why I looked at azcopy instead of storage explorer. Can you try setting this to some higher value? - Reply to this email directly, view it on GitHub<#2788 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABEY6OSSKH64YONGIZPUTTTZTRV4VAVCNFSM6AAAAABM4JE4LOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDGMJSGQZDEOBUGE>. You are receiving this because you were mentioned.Message ID: ***@***.***>

…

________________________________ Sports Information Services Limited. Registered Office: Whitehall Avenue, Kingston, Milton Keynes, Buckinghamshire, MK10 0AX. Company No. 4243307. The information in this email (which includes any files transmitted with it) is confidential and is intended for the addressee only. Unauthorized recipients are required to maintain confidentiality. If you have received this email in error please notify the sender immediately, destroy any copies and delete it from your computer system.

________________________________

[souravgupta-msft]

The AzCopy logs shared are old and the backend logs have rolled over. Can you retry and share the latest log file.
Before running, please tune the cap-mbps flag to some higher value. Since, you have restrictions on the bandwidth usage, you can also lower the concurrency value using this environment variable AZCOPY_CONCURRENCY_VALUE. For more details, refer this.