Skip to content

Conversation

@NaluTripician
Copy link
Contributor

@NaluTripician NaluTripician commented Sep 18, 2025

Pull Request Template

Description

We plan to re-add the response region field in the diagnostics for hedged requests for a general quick way to view this information. This change will affect the diagnostics for all requests with hedging, and PPAF enabled. This will not affect the behavior of those requests, only add one field to the diagnostics.

We want to make it clear that there might be cases the response region may not indicate the correct response region at that point due to some edge case scenarios that can come up depending on what the hedging configuration is. (This is one of the reasons why we decided to remove it originally). The only true way to know where a response came from will be to parse the diagnostic string to see where the storeresponse (or httpresponse if in gatewaymode). We cannot add a 100% accurate standalone parameter in the diagnostics as this will have a negative effect on the response time and CPU overhead which would negate the benefits of hedging.

The aim of adding this parameter back is to help customers get a quick understanding of where the hedging response came from.

Diagnostics improvements:

  • Added a new diagnostic datum, Response Region, to record the actual region that serviced the request in the diagnostics trace for each hedged response. This helps differentiate between the intended target region and the region that ultimately processed the request. [1] [2] [3]

Response tracking enhancements:

  • Updated the CloneAndSendAsync and RequestSenderAndResultCheckAsync methods to pass and record the target region name for each hedged request, ensuring accurate tracking of which region was intended to handle each request. [1] [2]
  • Modified the HedgingResponse class to include a new TargetRegionName field, allowing each response to carry information about its intended region.
  • Updated all usages of HedgingResponse to properly set and propagate the TargetRegionName for both successful and unsuccessful responses.

Type of change

Please delete options that are not relevant.

  • [] New feature (non-breaking change which adds functionality)

Closing issues

To automatically close an issue: closes #5408

@NaluTripician NaluTripician self-assigned this Sep 18, 2025
@NaluTripician NaluTripician added the Hedging Any issue/feature request related to request hedging label Sep 18, 2025
@NaluTripician NaluTripician added the auto-merge Enables automation to merge PRs label Sep 24, 2025
Copy link
Member

@kundadebdatta kundadebdatta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Member

@FabianMeiswinkel FabianMeiswinkel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@FabianMeiswinkel FabianMeiswinkel merged commit 8f26edb into master Sep 30, 2025
27 checks passed
@FabianMeiswinkel FabianMeiswinkel deleted the users/nalutripician/hedingReAddResponseRegionToDiagnostics branch September 30, 2025 22:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge Enables automation to merge PRs Hedging Any issue/feature request related to request hedging

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Re-add response region to hedging diagnostics

5 participants