Skip to content

Conversation

@g2vinay
Copy link
Member

@g2vinay g2vinay commented Feb 22, 2021

Adds Performance Test for Bearer Token Challenge Auth Policy and for the Token Caching API in Identity SDK,
Follows this flow for the Challenge Authentication policy performance test.

image

Follows this flow for the Token Caching API performance test.

image

@ghost ghost added the Azure.Core azure-core label Feb 22, 2021
@g2vinay g2vinay changed the title Add CAE performance test. Add Bearer Token Challenge Auth Policy performance test. Feb 22, 2021
@g2vinay g2vinay marked this pull request as ready for review March 15, 2021 17:45
/**
* The Performance Test class for Bearer Token Authentication Challenge Policy.
*/
public class ARMChallengeAuthenticationPolicyTest extends PerfStressTest<PerfStressOptions> {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this named ARM? This isn't related to the management plane right?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this policy is for ARM SDK.
We will work with ARM folks and move it there later on.

@g2vinay g2vinay requested a review from mikeharder March 23, 2021 22:30
ghost pushed a commit to Azure/azure-sdk-for-js that referenced this pull request Apr 1, 2021
This PR adds the package `@azure-tests/perf-identity` and a first performance test for Identity.

Here's the output from one run I did locally:

```
=== Calling globalSetup() once for (all) the instance(s) of ClientSecretCredentialPersistenceTest ===

=== warmup mode, iteration 0. Logs every 1s ===
Current         Total           Average
1589            1589            1590.49
=== warmup mode, results of iteration 1 ===
Completed 1,591 operations in a weighted-average of 1.00s (1,589.46 ops/s, 0.001 s/op)

=== test mode, iteration 0. Logs every 1s ===
Current         Total           Average
  credential?: ClientSecretCredential;
2439            2439            2442.35
3036            5475            2739.85
3080            8555            2856.42
2789            11344           2820.61
3186            14530           2893.90
3110            17640           2927.82
3258            20898           2973.09
2981            23879           2974.87
3188            27067           2997.42
=== test mode, results of iteration 1 ===
Completed 30,051 operations in a weighted-average of 10.00s (3,005.92 ops/s, 0.000 s/op)
```

I used Key Vault Keys as a reference to write these files: https://github.com/Azure/azure-sdk-for-js/tree/master/sdk/keyvault/perf-tests/keyvault-keys

As far as I could tell form Java's PR ([link](Azure/azure-sdk-for-java#19360)) the two goals for the Identity performance tests at the moment are:

1. Testing the challenge processing features on core, for which I have made a separate issue, since this feature is not yet in our main branch: #14633 .
    - The separation will also help reduce the number of changes to see when that perf test comes, since this one will have added all of the necessary files and folders around.
2. Testing the persistence feature, which this PR includes.

Let me know how it looks! Any feedback appreciated.

Fixes #14632
@ghost ghost added the no-recent-activity There has been no recent activity on this issue. label Feb 25, 2022
@ghost
Copy link

ghost commented Feb 25, 2022

Hi @g2vinay. Thank you for your interest in helping to improve the Azure SDK experience and for your contribution. We've noticed that there hasn't been recent engagement on this pull request. If this is still an active work stream, please let us know by pushing some changes or leaving a comment. Otherwise, we'll close this out in 7 days.

@ghost ghost closed this Mar 4, 2022
@ghost
Copy link

ghost commented Mar 4, 2022

Hi @g2vinay. Thank you for your contribution. Since there hasn't been recent engagement, we're going to close this out. Feel free to respond with a comment containing "/reopen" if you'd like to continue working on these changes. Please be sure to use the command to reopen or remove the "no-recent-activity" label; otherwise, this is likely to be closed again with the next cleanup pass.

This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Azure.Core azure-core no-recent-activity There has been no recent activity on this issue.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants