Add $partitions system table to Delta Lake Connector

[jayzzh]

Add partitions system table to Delta Lake Connector

This PR implements the $partitions system table in the Delta Lake Connector.

Additional context and related issues

Closes #18590. This PR iterates off a previously closed PR. I spoke with the original author and he is fine with me taking over where he has left off, so moving forward, I will add additional changes to closing out the issue.

In this PR, when querying $partitions, the returning columns are partition, file_count, and total_size, data.

cc @findinpath @ebyhr

Release notes

(x) Release notes are required, with the following suggested text:

# Delta Lake
* Add support for `$partitions` system table ({issue}`18590`)

[cla-bot]

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to [email protected]. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

[cla-bot]

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to [email protected]. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

[findinpath]

It seems to me that the PR is going in the right direction. Good job so far.

[findinpath]

The failures in ci/pt (default, suire-delta-lake-oss) are related to your changes

| 2024-03-09 10:35:46 INFO: FAILURE     /    io.trino.tests.product.deltalake.TestHiveAndDeltaLakeRedirect.testHiveToPartitionedDeltaPartitionsRedirectFailure (Groups: profile_specific_tests, delta-lake-oss) took 1.5 seconds
tests               | 2024-03-09 10:35:46 SEVERE: Failure cause:
tests               | java.lang.AssertionError: Expected callback to throw QueryExecutionException
tests               | 	at io.trino.tempto.assertions.QueryAssert.assertQueryFailure(QueryAssert.java:113)
tests               | 	at io.trino.tests.product.deltalake.TestHiveAndDeltaLakeRedirect.testHiveToPartitionedDeltaPartitionsRedirectFailure(TestHiveAndDeltaLakeRedirect.java:154)

[findinpath]

Functionality wise you're getting there.
Let's clarify the part related unpartitioned tables.

Thank you for your effort so far.

[findinpath]

LGTM % last comment

[findinpath]

@jayzzh could you please continue the work on this PR?
We've done good progress so far. ❤️

[ebyhr]

Please fix CI failure.

Also, please add @whitleykeith as co-author of the commit.

[findinpath]

LGTM % comments

[ebyhr]

Looks good except for data column implementation.

[ebyhr]

Please refactor the helper method to avoid passing redundant non-partition column a and b.

[jayzzh]

Do you have recommendation on how not to pass in a and b? Also a and b are values in the partition column.