Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AzCopy Release 10.16.0 #1851

Merged
merged 28 commits into from
Jul 21, 2022
Merged

AzCopy Release 10.16.0 #1851

merged 28 commits into from
Jul 21, 2022

Commits on May 12, 2022

  1. Configuration menu
    Copy the full SHA
    8256852 View commit details
    Browse the repository at this point in the history

Commits on May 17, 2022

  1. Exported azcopyAppPathFolder variable.

    nitin-deamon authored and root committed May 17, 2022
    Configuration menu
    Copy the full SHA
    aad8cad View commit details
    Browse the repository at this point in the history
  2. Fix for large file blocksize calculation.

    - This fix in respect to support 190TB files.
      As of now due to wrong calculation after 24T azcopy fails.
    nitin-deamon authored and root committed May 17, 2022
    Configuration menu
    Copy the full SHA
    cefe16f View commit details
    Browse the repository at this point in the history
  3. Handle panic error when plan file is empty.

    nitin-deamon authored and root committed May 17, 2022
    Configuration menu
    Copy the full SHA
    1bc304d View commit details
    Browse the repository at this point in the history

Commits on May 18, 2022

  1. Configuration menu
    Copy the full SHA
    b5e2fd0 View commit details
    Browse the repository at this point in the history

Commits on May 19, 2022

  1. Merge pull request #1792 from Azure/users/GitHubPolicyService/edce9a8…

    …9-348f-4807-9ca8-da332f99cbb8
    
    Adding Microsoft SECURITY.MD
    mohsha-msft authored May 19, 2022
    Configuration menu
    Copy the full SHA
    c08e31a View commit details
    Browse the repository at this point in the history

Commits on May 23, 2022

  1. Merge pull request #1785 from Azure/personal/arnav/xdatamove-frontend

    Introduce xdm-relevant changes to and fix frontend
    Strikerzee authored May 23, 2022
    Configuration menu
    Copy the full SHA
    1410fe1 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2022

  1. Configuration menu
    Copy the full SHA
    82845b5 View commit details
    Browse the repository at this point in the history
  2. output-level-tiverma (#1772)

    * output-level=default;essential;quiet
    
    * default value of flag
    
    * solving conversations
    
    * adding quiet mode (output-level) to rm and sync
    
    * adding quiet mode (output-level) to rm and sync
    
    * adding dry-run vs output-level validation to copy, rm, sync
    
    * move setting outputVerbosity to root.go
    
    * removing redundant code from Prompt()
    
    * cleaning code in processOutputMessage()
    tiverma-msft authored May 26, 2022
    Configuration menu
    Copy the full SHA
    3652e23 View commit details
    Browse the repository at this point in the history

Commits on Jun 1, 2022

  1. Linux/POSIX properties persistence (#1780)

    * SIP Implementation
    
    * Opt for an interface instead of a struct
    
    * Implement upload
    
    * Implement file creation
    
    * Implement property setting; todo: error handling
    
    * Error handling
    
    * Add upload support to append/page blob
    
    * Implement flag
    
    * Somewhat fix download
    
    * Handle folder uploading/copying
    
    * Remove download
    
    * Fix getUNIXProperties
    
    * Remove device filtering
    
    * Convert flag to bool
    
    * Attempt to fix accidental folder transfers
    
    * Fix test function signatures
    
    * Add preserve-posix-properties to sync
    
    * Limit auto-setting to sync and copy
    
    * Default to false
    
    * Potentially fix testing
    
    * Add check for flag
    
    * Shift back to single-call
    
    * Handle comments on PR
    
    * Add includeDirectoryStubs to folder property considerations
    
    * Address final comments
    adreed-msft authored Jun 1, 2022
    Configuration menu
    Copy the full SHA
    698f69a View commit details
    Browse the repository at this point in the history

Commits on Jun 2, 2022

  1. Moving log-level to root.go (#1804)

    * location of bug
    
    * moving log-level to root command
    
    * making logVerbosity variable in root.go
    
    * passing correct values while making logger
    
    * removing logVerbosity from raw and cooked
    
    * removing logVerbosity from zt files raw args
    
    * some prob with conflict resolution
    tiverma-msft authored Jun 2, 2022
    Configuration menu
    Copy the full SHA
    9af831a View commit details
    Browse the repository at this point in the history
  2. Avoid creating .azcopy under HOME if plan/log location is specified e…

    …lsewhere (#1782)
    
    * avoiding creation of .azcopy if log and plan files have user defined loc
    
    * making azcopyAppPathFolder string irrespective of folder creation
    
    * accessToken to be created where plan files are
    
    * adding TODO
    
    * making same changes in main_unix.go
    
    * getting rid of azcopyAppPathFolder
    
    * making azcopyAppPathFolder before making plan folder to avoid err
    tiverma-msft authored Jun 2, 2022
    Configuration menu
    Copy the full SHA
    8346fe9 View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2022

  1. set-properties command (#1778)

    * adding new files setProperties
    
    * updating copy.go and helpMessages.go
    
    * updating cmd files for setProperties
    
    * updating ste files for setProperties
    
    * updating ste files for setProperties
    
    * solving issues with code
    
    * fixing problem with rehydrate priority
    
    * adding archiveStatus to list
    
    * adding test files
    
    * adding dry-run mode
    
    * reformatting dry-run code
    
    * adding metadata and blobtier to tests
    
    * removing redundant code from makeTransferEnum()
    
    * validating metadata
    
    * assuring empty metadata is handled in set-props
    
    * assuring tier is not archive if BlobFS
    
    * Files and SAS token not allowed
    
    * Files and SAS token not allowed
    
    * adding tests for empty metadata and blob tags
    
    * printing unescaped URL in dry-run
    
    * showing failed when using auto-login resolution
    
    * the specified blob does not exist error and not hang
    
    * totalBytesTransferred = 0
    
    * oopsie
    
    * showing failed when using auto-login resolution - 2
    
    * empty blob tags given to clear existing tags
    
    * removing done TODO
    
    * moving resetSourceSize so that progress is displayed correctly
    
    * complying with pulled changes
    
    * introducing "flush" to flush blobtags and metadata
    
    * avoiding import cycle
    
    * getting up to date with latest merges in dev
    
    * getting up to date with latest merges in dev -2
    
    * printing metadata if error in it
    
    * printing metadata if error in it
    
    * moving flushflag to fe-ste-models.go
    
    * only metadata key should be a C# identifier
    
    * changing flush flag to clear flag
    
    * using strings.EqualFold for case insensitivity
    
    * pretty output
    
    * description and checkIfChangesPossible() change
    
    * metadata can't be set if blob is set to be archived
    
    * doing TODOs and silenting ValidateTier()
    
    * adding short and long descr. and examples
    
    * fixing usage definition
    
    * bytes transferred = 0 not showing correctly, fix
    
    * removing invalid comment
    tiverma-msft authored Jun 6, 2022
    Configuration menu
    Copy the full SHA
    0910626 View commit details
    Browse the repository at this point in the history

Commits on Jun 7, 2022

  1. Job Manager changes (#1820)

    * Combine all JobMgr changes into one.
    
    JobMgr Cleanup.
    
    - Close all the go routines once job is done.
    
    Fix for Report Handler routine cleanup.
    
    Memory Leak Fix.
    
    - Set the nil to address allocated memory.
    
    - Fixing some of memory issues.
    
    - JobMgr is freed without setting channel to nil.
    
    Co-authored-by: Nitin Singla <[email protected]>
    Strikerzee and nitin-deamon authored Jun 7, 2022
    Configuration menu
    Copy the full SHA
    9908569 View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2022

  1. Fix some oopsies in the unix properties PR (#1818)

    * Fix some oopsies in the unix properties PR
    
    * Apply changes to append/page blob
    adreed-msft authored Jun 9, 2022
    Configuration menu
    Copy the full SHA
    a56e3eb View commit details
    Browse the repository at this point in the history
  2. Fix symlink (#1798)

    * Squash "Fix the symlink" into one commit.
    
    Fix the symlink.
    
    - Calling filepath.evalsymlinks in case of linux.
    - Explicit checking "." (current directory) for symlink.
    
    Remove snippet of code not relevant to the cherry-picked commits.
    
    * Fix build error.
    
    * Fix rebase build errors.
    
    Co-authored-by: Nitin Singla <[email protected]>
    Strikerzee and nitin-deamon authored Jun 9, 2022
    Configuration menu
    Copy the full SHA
    583e6e7 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bf94c3d View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2022

  1. Allow calling app to cancel enumeration and handle scanning directory…

    … errors in traverser (#1803)
    
    * This patch for enabling calling app to cancel enumeration.
    
    - Used appCtx in parallel-walk so that when app want to cancel the
    enumeration it can do.
    - It doesn't effect azcopy working.
    
    * Replace context pointer with context and nil with context.TODO()
    
    * Handle scanning directory errors in traverser.
    
    * Fail visibly when scanning fails for files and directories
    
    * add in more error paths
    
    * fix processOneDirectory changes and add more comments
    
    * Minor fix.
    
    * Fix nil ptr dereference.
    
    * Resolve comments.
    
    * Replace err with err.Error() as per comments.
    
    * Minor fix.
    
    Co-authored-by: Nitin Singla <[email protected]>
    Strikerzee and nitin-deamon authored Jun 14, 2022
    Configuration menu
    Copy the full SHA
    0e4c1a7 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2022

  1. Fix race between Updating JobPart and xferDoneMsg (#1814)

    * Fix race between Updating JobPart and xferDoneMsg
    
    * Rename variable to more appropriate one
    
    * Close xferDone channel
    
    * Add missing continue
    
    * Fix rebase issue
    nakulkar-msft authored Jun 27, 2022
    Configuration menu
    Copy the full SHA
    42f9d06 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    265ac44 View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2022

  1. Configuration menu
    Copy the full SHA
    134d2b6 View commit details
    Browse the repository at this point in the history
  2. Improve error if we cannot determine if source is a directory (#1412)

    * Improve error if we cannot determine if source is a directory
    
    * Replace ste logger with scanning logger
    
    * Undo white space changes
    
    * Fix CI
    nakulkar-msft authored Jun 30, 2022
    Configuration menu
    Copy the full SHA
    05f98cf View commit details
    Browse the repository at this point in the history

Commits on Jul 4, 2022

  1. "dfs" to "blob" endpoint conversion (#1839)

    * DFS to Blob endpoint conversion.
    
    * DFS to Blob endpoint conversion.
    
    * DFS to Blob endpoint conversion.
    
    Co-authored-by: Mohit Sharma <[email protected]>
    mohsha-msft and mohitdtumce authored Jul 4, 2022
    Configuration menu
    Copy the full SHA
    b990b7b View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2022

  1. Configuration menu
    Copy the full SHA
    eb33497 View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2022

  1. Configuration menu
    Copy the full SHA
    4ad3e88 View commit details
    Browse the repository at this point in the history

Commits on Jul 13, 2022

  1. Configuration menu
    Copy the full SHA
    36aff75 View commit details
    Browse the repository at this point in the history

Commits on Jul 19, 2022

  1. Implement multi-auth for managed disks (SAS+OAuth) when the managed d…

    …isk export account requests it (#1844)
    
    * MD OAuth (mostly)
    
    * Reimplement MD-OAuth as a credential type signifying resource
    adreed-msft authored Jul 19, 2022
    Configuration menu
    Copy the full SHA
    8c5bd4f View commit details
    Browse the repository at this point in the history
  2. Update changelog and version for 10.16.0 (#1849)

    * Update changelog and version for 10.16.0
    
    * Update ChangeLog.md
    
    Co-authored-by: Narasimha Kulkarni <[email protected]>
    siminsavani-msft and nakulkar-msft authored Jul 19, 2022
    Configuration menu
    Copy the full SHA
    a1595ed View commit details
    Browse the repository at this point in the history