[Time series visual builder] Annotations do not respect filters

[alexfrancoeur]

The annotations in TSVB do not seem to be respecting the filters that apply to them. When setting an annotation for any memory usage >12GB, we get the following chart.

If I add a query or filter to only provide values < 12GB on a dashboard or visualization, the annotations are still seen.

As a user, I'd expect any query or filter to be applied to the annotations as well.

[simianhacker]

The only problem I see with applying the filters to the annotations is that you may not always want that behavior. Take the use case where the annotations are coming from a different index pattern which doesn't contain the field you're filtering on; annotations will not be display (think outage indicators or logging info). What we probably need is another option on the annotations like Apply Filters: yes/no or something like that.

The use case above was never considered but is very innovative 🥇

[alexfrancoeur]

cc: @skearns64 @tbragin

[alexfrancoeur]

@simianhacker I agree, it would be nice to have as a configurable option. I can see the benefits for keeping the annotations there when filtering the data. Even something like a toggle for annotations within the actual chart might be nice so one can show / hide on the fly

[skearns64]

One use-case for annotations in this way, would be showing detected ML Anomalies as an overlay to the raw data. The anomalies are held in a separate index from the original data. One tricky use-case would be filtering the raw data in one way (e.g. just machine X), and the annotations in another way (e.g. only show anomalies with scores >75, or show all).