Endpoint Interruption Logic for Model Overview with OD

[Advitya17]

mo_endpoint_1.mp4

Description

For scenarios such as OD & QA that use an endpoint to calculate Model Overview metrics, even if the metrics are drawn from the cache, there's still an execution invoked for the endpoint to correctly trigger the state change.

If there're any user interaction related to changing cohorts or quick user input changes while a previous endpoint instance is running, the dashboard would fall into an error. This PR adds abort logic to the endpoint such that a change in user inputs aborts the previous execution to avoid errors in the state or cohort values.

A future PR would add corresponding support to QA as well.

Checklist

• I have added screenshots above for all UI changes.
• I have added e2e tests for all UI changes.
• Documentation was updated if it was needed.

[github-actions]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/agemawat/endpoint_abort/dashboard/index.html

[romanlutz]

Nice, also thank you for adding the video!

Have we considered adding a spinner while it's loading?

[Advitya17]

Nice, also thank you for adding the video!

Have we considered adding a spinner while it's loading?

Thanks for the review, @romanlutz! It has come up in discussions before, but we haven't put that in the backlog just yet. Currently we're making do with N/A until values are rendered, but could see in a future PR if spinners inside the table values is (a) feasible to put in (instead of a string), and (b) preferred PM decision.

Let me know your thoughts and can bring it to discussion accordingly.

[github-actions]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/agemawat/endpoint_abort/dashboard/index.html

[github-actions]

https://responsibleai.blob.core.windows.net/pullrequest/microsoft/responsible-ai-toolbox/agemawat/endpoint_abort/dashboard/index.html