Improve latency for HBO optimizer

[feilong-liu]

Description

Part of #20355

This PR optimizes the latency for HBO optimizer from the following aspects:

• Check timeout for plan canonicalization, plan hash and return empty when timeout
  Previously it only checks timeout for meta data access, and do not return immediately when timeout. However, we found that plan canonicalization and hash can also be time consuming. And we need to check for these two, and also return immediately when timeout.
• Add a flag to specify whether to fetch HBO related data from cache only. It's false when register the query, and true when getting statistics
  In the design of HBO, all HBO related stats are fetched and cached during query registration in HistoricalStatisticsEquivalentPlanMarkingOptimizer optimizer, and following fetch of stats will access from cache. This PR adds a new parameter cacheOnly to corresponding methods to enforce this behavior.
• Add verbose run time stats for plan hash, plan canonicalization and meta data read
  This is only enabled when verbose runtime flag is set to true, and will help to debug HBO timeout.

Motivation and Context

This is to reduce the latency of HBO optimizer.

Impact

Tested with a few production queries, see significant drop of latency for HBO optimizer.

Test Plan

Add unit tests. Also tested locally end to end to verify that HBO optimizer latency decreased. In tests, queries which takes minutes to have HBO optimizer timeout now timeouts within specified timeout limit, i.e. 20seconds.

Contributor checklist

• Please make sure your submission complies with our development, formatting, commit message, and attribution guidelines.
• PR description addresses the issue accurately and concisely. If the change is non-trivial, a GitHub Issue is referenced.
• Documented new properties (with its default value), SQL syntax, functions, or other functionality.
• If release notes are required, they follow the release notes guidelines.
• Adequate tests were added if applicable.
• CI passed.

Release Notes

Please follow release notes guidelines and fill in the release notes below.

== RELEASE NOTES ==

General Changes
* Improve latency of history based optimizer

[feilong-liu]

cache only is set to false, as this is during registration of plan, hence we are supposed to have nothing in cache and populate the cache for future use.

[feilong-liu]

Only return hash when it's present, the returned hash can be empty if the "planCanonicalInfoProvider.hash" timeout.

[feilong-liu]

This is within "getStatistics" function which is called when reading estimates from HBO, and we set cacheOnly to true here, as we are supposed to already have cache here, and we do not want to calculate on the fly if cache miss during cost based planning.

[feilong-liu]

Similarly set to cacheOnly to true as it's within getStatistics function.

[feilong-liu]

If cacheOnly set to true, return whatever got from cache. This field will be false during registration call in HBO optimizer, so that all data is calculated and cached during registration, and later usage will only read form cache.

[feilong-liu]

Return early if timeout

[feilong-liu]

This function is called at the end to collect the HBO information, hence cacheOnly set to true.

[mlyublena]

Nice finds!

[tdcmeehan]

Please improve the release note message (see guidelines). Suggestion:

Improve latency of history based optimizer

[ajaygeorge]

LGTM % a nit