Skip to content

docs(observability): list the Global Frontend affinity metrics - #18190

Open
sachalmalick wants to merge 1 commit into
sachalmalick/global-router-dynamodb-affinityfrom
sachalmalick/global-router-affinity-docs
Open

sachalmalick wants to merge 1 commit into
sachalmalick/global-router-dynamodb-affinityfrom
sachalmalick/global-router-affinity-docs

Conversation

@sachalmalick

Copy link
Copy Markdown
Contributor

Overview

Stacked on #17675. That PR adds DynamoDB-backed session affinity to the Global Frontend, along with five new affinity metric families. This PR adds their Metrics Catalog entries. They are split out so #17675 can be reviewed by the global-router owners while the docs team reviews this one.

Review and merge this after #17675. Until then its diff is shown against that PR's branch.

Key Changes

docs/fern/pages/reference/observability/metrics-catalog.mdx, Global Frontend section. These metrics are served only with --router-policy affinity and are all marked experimental:

  • dynamo_global_frontend_overhead_affinity_store_ms (histogram): time spent in affinity storage per session request. It is named and bucketed like dynamo_router_overhead_shared_cache_query_ms.
  • dynamo_global_frontend_affinity_lookups_total{outcome}: lookups that found a pin (hit) or didn't (miss).
  • dynamo_global_frontend_affinity_store_errors_total{kind}: requests that routed without affinity, by backend, timeout, conflict or breaker_open.
  • dynamo_global_frontend_affinity_store_writes_total{reason}: store writes, by create, move, refresh or repair.
  • dynamo_global_frontend_affinity_cache_total{outcome}: reads served from the in-process cache (hit) or from the store (miss), and cache entries dropped (invalidation).

Validation

The entries match the names, labels and help text the Global Frontend registers in #17675 (lib/global-frontend/src/metrics.rs). A unit test there checks the rendered names and values.

Issues and Ongoing Work

🤖 Generated with Claude Code

Adds the five affinity metric families the Global Frontend serves with
`--router-policy affinity` to the Metrics Catalog, all experimental:
overhead_affinity_store_ms, affinity_lookups_total,
affinity_store_errors_total, affinity_store_writes_total and
affinity_cache_total.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Sachal Malick <s@chal.ai>
@sachalmalick
sachalmalick requested a review from a team as a code owner November 5, 2026 10:39
@copy-pr-bot

copy-pr-bot Bot commented Nov 5, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@github-actions github-actions Bot added docs documentation Improvements or additions to documentation labels Nov 5, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs documentation Improvements or additions to documentation size/S

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant