Infer required Delta Lake version from table features

[alexjo2144]

Description

Rather than require users upgrade the protocol version on their tables before using features which require newer versions of the spec, automatically determine which protocol version is required and upgrade the table to it.

Additional context and related issues

Includes one commit from @homar's #16221

Release notes

( ) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
(x) Release notes are required, with the following suggested text:

# Delta Lake
* Infer required Delta Lake version when creating new tables or enabling new table features.

[homar]

Why didn't you add testTurningOnAndOffCdfFromTrino that I added to testing/trino-product-tests/src/main/java/io/trino/tests/product/deltalake/TestDeltaLakeDatabricksChangeDataFeedCompatibility.java ?

[alexjo2144]

Because the commit message made it sound like I could skip it "Add flaky to all tests...", maybe it should be in the second commit, or a separate one all together?

[homar]

Because the commit message made it sound like I could skip it "Add flaky to all tests...", maybe it should be in the second commit, or a separate one all together?

I added Flaky annotations to all methods in that class in a first commit and it made sense to skip that commit, but in the second commit that you actually used I added a test case there, and @ebyhr thought it is important because he wanted me to test some particular cases there so I think that one test should be here.

I will add @flaky to all tests in that class in a separate pr

[alexjo2144]

Thanks for the reviews, all addressed

[krvikash]

LGTM

[krvikash]

double space

[findepi]

cc @trinodb/maintainers @colebow i marked this one as a release-blocker, because it's important to get this into the release.
This is not a typical release blocker. It removes some recently introduced properties (#16332) and the goal here is to minimize the time window during which these are available to effectively minimize any negative consequences.