-
Notifications
You must be signed in to change notification settings - Fork 2.9k
docs(rfcs): add triage automation rfc #24817
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.
Already on GitHub? Sign in to your account
Changes from 2 commits
1d6b30e
22d3982
9117d9b
d9b832f
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,161 @@ | ||
| # RFC: Triage automation (Shield) | ||
|
|
||
| <!-- | ||
| An RFC can be anything. A question, a suggestion, a plan. The purpose of this template is to give some structure to help folks write successful RFCs. However, don't feel constrained by this template; use your best judgement. | ||
|
|
||
| Tips for writing a successful RFC: | ||
|
|
||
| - Simple plain words that make your point, fancy words obfuscate | ||
| - Try to stay concise, but don't gloss over important details | ||
| - Try to write a neutral problem statement, not one that motivates your desired solution | ||
| - Remember, "Writing is thinking". It's natural to realize new ideas while writing your proposal | ||
| --> | ||
|
|
||
| _contributors:_ _@hotell_ | ||
|
|
||
| --- | ||
|
|
||
| ## Summary | ||
|
|
||
| We wanna make initial triage-ing issues a fully automated process. | ||
|
|
||
| ## Problem statement | ||
|
|
||
| At the moment processing newly created issues is mostly manual work done by 2 people on shield duty. While this was a good start it wont scale as the codebase/team/contributors list grows. Thus we need to introduce automation to establish best possible contributors DX while they need our help. | ||
|
|
||
| <!-- | ||
| Why are we making this change? What problem are we solving? What do we expect to gain from this? | ||
|
|
||
| This section is important as the motivation or problem statement is indepenent from the proposed change. Even if this RFC is not accepted this Motivation can be used for alternative solutions. | ||
|
|
||
| In the end, please make sure to present a neutral Problem statement, rather than one that motivates a particular solution | ||
| --> | ||
|
|
||
| ## Detailed Design or Proposal | ||
|
|
||
| <!-- This is the bulk of the RFC. Explain the proposal or design in enough detail for the inteded audience to understand. --> | ||
|
|
||
| After we [introduced new github issues beta](https://github.com/microsoft/fluentui/pull/22337) for reporting issues and feature request, the experience for both contributors and shield devs was significantly improved. A followup that was discussed is to implement further automation by leveraging Github Actions, This document will describe the approach in better detail. | ||
|
|
||
| We would like to automate following steps: | ||
|
|
||
| 1. project label assignment | ||
| 2. package label assignment | ||
| 3. assign issue to project board/team | ||
|
|
||
| **Pre-requirements:** | ||
|
|
||
| - normalization/unification of labels within monorepo for projects | ||
|
|
||
| _Current state:_ | ||
|
|
||
| - 2 labels for v0 | ||
| - https://github.com/microsoft/fluentui/labels?q=northstar | ||
| - 2 labels for v9 | ||
| - https://github.com/microsoft/fluentui/labels/Fluent%20UI%20react-components%20%28v9%29 | ||
| - https://github.com/microsoft/fluentui/labels/Fluent%20UI%20vNext | ||
| - per component labels | ||
| - same labels mixed for various fluent version https://github.com/microsoft/fluentui/labels/Component%3A%20Dialog | ||
|
|
||
| _Expected state:_ | ||
|
|
||
| - 1 label for v0 | ||
| - 1 label for v9 | ||
| - label per published package | ||
| - "component labels" can stay as are but should be used solely for v8 (internal react package "sub-packages" https://github.com/microsoft/fluentui/labels/Component%3A%20Dialog) | ||
|
|
||
| ### 1. project label assignment | ||
|
|
||
| > Note: | ||
| > | ||
| > - by "project" we mean one of libraries that exist within monorepo (v0,v8,v9,web-components) | ||
|
|
||
| **Workflow:** | ||
|
|
||
| Based on selected project within issue template, we should add appropriate label. | ||
|
|
||
| <img width="1108" alt="image" src="https://user-images.githubusercontent.com/1223799/190106473-fd007d87-f09a-4493-aafd-781a8404ae45.png"> | ||
|
|
||
| > NOTE: | ||
| > | ||
| > - this is already implement via [github action](https://github.com/microsoft/fluentui/pull/24788) | ||
|
|
||
| ### 2. package label assignment | ||
|
|
||
| > Note: | ||
| > | ||
| > - by "package" we mean official package name used to publish to npm registry without `@scope` prefix | ||
|
|
||
| **Workflow:** | ||
|
|
||
| Based on selected project within issue template, additional select should be dynamically generated so contributor can pick proper package. | ||
|
|
||
| <img width="569" alt="example of flow" src="https://user-images.githubusercontent.com/1223799/190431945-56fcd343-6eb7-4145-b2b2-62f5919b8c31.png"> | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I agree with ling1726 partners are supposed to use just the suite package, we should not ask them to guess the individual package.
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
We can, but it might be impossible to identify those as packages export various Controls. Two approaches come to my mind:
I'd recommend to go with 2), WDYT?
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. option 2 good enough 馃憤 |
||
|
|
||
| Unfortunately **[dynamic input controls are not possible with github issues beta](https://github.com/community/community/discussions/29067)** which leaves us with following options how to implement this: | ||
|
|
||
|
Comment on lines
+92
to
+97
Contributor
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Does this allow you to select multiple packages? Or in case the issue affected multiple packages, how would the scenario proceed?
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. good question, we can enable multiple items selected with github forms https://docs.github.com/en/communities/using-templates-to-encourage-useful-issues-and-pull-requests/syntax-for-githubs-form-schema#dropdown. What would be the use-case ? to provide more context: Our template is aimed mainly for 3rd party with workflow. Meaning: "Im using fluent, Im using this component and it doesn't work for me." From my experience user reports issue for the immediate thing that comes in his way( component A ). Additionally one can dig deeper and find that the issue is within some underlying component (Component B) - thus the reporter should pick that one. In general having fine grained issue reports reduces the complexity and time to identify the problem. This is omnipresent everywhere - dissecting task to smaller ones/ atomic commits/small PR's. to wrap up I'm IMO it shouldn't be needed. but as mentioned the option is there |
||
| - use only package names in "Library" picker | ||
| - cons | ||
| - huge list because we have quite a lot packages | ||
| - pros | ||
| - only 1 issue/feature template that we need to maintain | ||
| - removes need of `1. project label assignment` as labeling would be handled in one step | ||
| - creating feature/bug templates per library | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. I vote for template per library.
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. updated d9b832f |
||
| - cons | ||
| - 2 (feature/bug) x N templates (N is number of libraries in monorepo) | ||
| - pros | ||
| - clear separation that can be tweaked to particular library needs if needed | ||
| - creating completely custom issue form solution (example [vuejs](https://github.com/vuejs/vue/issues/new/choose)) | ||
| - cons | ||
| - big effort in terms of development and maintenance | ||
| - pros | ||
| - complete control about issue reporting | ||
| - another possible dog food for v9 controls | ||
|
|
||
| **How will we maintain list of packages in issue template:** | ||
|
|
||
| On library creation/removal we will tweak our issue/feature template automatically. | ||
|
|
||
| > Note: | ||
| > | ||
| > - this can also happen only after created package has been published to npm registry ( post release GH action) | ||
|
|
||
| ### 3. assign issue to project board/team | ||
|
|
||
| Based on assigned labels, we can automate assignment of issues based on our source of truth of ownership which is `CODEOWNERS` file. | ||
|
|
||
| **Workflow:** | ||
|
|
||
| ```mermaid | ||
| graph TD; | ||
| I("issue template created")-->L("labels added")-->C("parse codeowners"); | ||
| subgraph "parse codeowners" | ||
| C-->D("find owner based on package") | ||
| end | ||
| D-->A("add issue to unified board")-->AA("pick team based on ownership definition"); | ||
|
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. The role of the shield is to:
In order to be able to do that, shield often needs to talk back to the reporter and/or debug the issue. As a side effect, the person on shield widen their knowledge to cover the whole library (useful for both support and development). If the bot assigns the issues automatically, then:
For that reason I would prefer the bot to suggest the owner but would still let shield to the check/assignment.
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more.
that's fine, it will still contain "needs triage" label, so person on shield can double check. we can create a view in project board that will show all "need triage" items for better visibility and post-bot processing. WDYT ?
Member
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Works for me. I still think that shield is valuable and should visit every incoming issue for triage/investigation. |
||
| ``` | ||
|
|
||
| ## Pros and Cons | ||
|
|
||
| **Cons:** | ||
|
|
||
| - some amount of maintenance | ||
|
|
||
| **Pros:** | ||
|
|
||
| - improved issues reporting experience | ||
| - improved post-triaging experience and prioritization | ||
| - no need for: | ||
| - human interaction for initial triaging | ||
| - manual communication that can "get lost" and can take extra time (time-zone constraints) | ||
| - extra number of humans needed on Shield | ||
|
|
||
| ## Discarded Solutions | ||
|
|
||
| <!-- As you enumerate possible solutions, try to keep track of the discarded ones. This should include why we discarded the solution. --> | ||
|
|
||
| NONE | ||
|
|
||
| ## Open Issues | ||
|
|
||
| <!-- Optional section, but useful for first drafts. Use this section to track open issues on unanswered questions regarding the design or proposal. --> | ||

There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
does this make sense with respect to the current expectations for partners ? We actively encourage partners to use
@fluentui/react-components. Using package labels instead of component labels seems like we are fighting against our own recommendation to use the suite packageThere was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not sure I understand the concern?
- by "project" we mean one of libraries that exist within monorepo (v0,v8,v9,web-components)we do this today - add label based on project , NOT granular package.
probably you're asking about option 2 (
2. package label assignment)?can you pls clarify? ty
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes I 'm asking about
packge label assignmentwhy should we oblige users to select the correct package in our monorepo when the only exposure they have (and we do it intentionally) is the library package ?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
answered with proposal #24817 (comment)
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated RFC d9b832f