docs: add business KPI best practice to metrics page - #3720
Conversation
|
@strandly-the-agent is that correct? do we need to add it? |
|
TL;DR: the content is correct — I checked it against the linked page, and it's close to verbatim. I'd take it, but with one tweak: as written it's advice the page gives the reader no way to act on. Correct? Yes. The lens's Operational Excellence design principle "Operate by KPIs that map to business outcomes" says: "Resolution rate, escalation rate, customer satisfaction, and task completion sit alongside infrastructure metrics with equal weight in dashboards and reviews." So the four example KPIs and the "equal weight" framing are accurately sourced, and the URL resolves. Precedent for citing this lens is already on the page — best practice #2 links the same doc ( Need it? It's a reasonable addition, but the gap is that nothing the SDK emits covers business outcomes, and this page never says where they'd come from — so the item reads as generic advice on an otherwise concrete reference page. One clause pointing at the mechanism fixes that. Suggested wording for item 5
The anchor targets the One thing I did not flag: the added line is ~600 chars, over the 90-char limit in Review, not a verdict — |
|
Thanks for the contribution |
Description
This PR adds a best practice to the metrics page recommending that teams track business-outcome KPIs (for example, resolution rate, escalation rate, task completion, and customer satisfaction) alongside SDK-generated technical metrics.
Currently, the metrics page primarily focuses on SDK-emitted metrics, which may leave readers with the impression that metrics are limited to what the SDK tracks. In contrast, the Observability page already describes a broader set of metrics, including customer feedback and retention data. As a result, the metrics page's best practices do not reflect that broader scope. This addition aligns with the "Operate by KPIs that map to business outcomes" design principle in the AWS Well-Architected Framework Agentic AI Lens, which is linked for further guidance.
Related Issues
Documentation PR
Type of Change
Documentation update
Testing
How have you tested the change? Verify that the changes do not break functionality or introduce new warnings.
hatch run prepareChecklist
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.