Skip to content

HttpRecorder optimization for large recorded files#4597

Merged
shahabhijeet merged 1 commit into
Azure:psSdkJson6from
shahabhijeet:hrec
Jul 29, 2018
Merged

HttpRecorder optimization for large recorded files#4597
shahabhijeet merged 1 commit into
Azure:psSdkJson6from
shahabhijeet:hrec

Conversation

@shahabhijeet
Copy link
Copy Markdown
Contributor

  • LRO retries makes the recorded file size bigger, that results in failing to open on CI machine when CI machines are running low on resources.
  • Adding feature to http recorder to compress LRO recorded files. This will eliminate LRO retries during playback.
  • The current iteration of optimization resulted in eliminating ~40% LRO payload out of recorded files.
  • During compacting of the files, it creates a backup of original file incase the test author decides to have both recordings (uncompressed as well as compressed)
  • Added additional key-vaule pair to trigger compressing recorded file in testFx. The new Key-Value pair is OptimizeRecordedFiles=true/false
  • Added unit tests. Recorded full E2E tests and compressed the recorded file.
  • Refactored test project to minimize redundant files, refactored namespaces in test projects.
  • Rearranged project files to comply building with multiple target frameworks.
  • Added additional meta data that will allow to query recorded data on multiple pivots (operation type, header type etc.)
    HttpRecorder optimization #3213

…ing to open on CI machine when CI machines are running low on resources.

Adding feature to http recorder to compress LRO recorded files. This will eliminate LRO retries during playback.
The current iteration of optimization resulted in eliminating ~40% LRO payload out of recorded files.
During compacting of the files, it creates a backup of original file incase the test author decides to have both recordings (uncompressed as well as compressed)
Added additional key-vaule pair to trigger compressing recorded file in testFx. The new Key-Value pair is OptimizeRecordedFiles=true/false
Added unit tests. Recorded full E2E tests and compressed the recorded file.
Refactored test project to minimize redundant files, refactored namespaces in test projects.
Rearranged project files to comply building with multiple target frameworks.
Added additional meta data that will allow to query recorded data on multiple pivots (operation type, header type etc.)
@shahabhijeet shahabhijeet merged commit 91f56d7 into Azure:psSdkJson6 Jul 29, 2018
@shahabhijeet shahabhijeet deleted the hrec branch September 4, 2018 19:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant