feat: support ArrowReaderOptions

[lgingerich]

Which issue does this PR close?

• Closes Support ArrowReaderOptions #1934 .

What changes are included in this PR?

• Add support for ArrowReaderOptions
• This PR does not actually hook up ArrowReaderOptions to be used anywhere as get_metadata is currently only called from parquet_files_to_data_files() which is marked as dead_code.
  • Given this, it's essentially a no-op change, though fixes a minor issue for future integration with ArrowFileReader.

Are these changes tested?

Tested with existing test suite.

[lgingerich]

I've confirmed that the failing CI / Unit Tests passes for me locally (MacOS)

[liurenjie1024]

Thanks @lgingerich for this pr!

[liurenjie1024]

Why we need to change this? We expect to keep parquet version same as arrow.

[lgingerich]

I didn't realize it initially, but the necessary ParquetMetaDataReader method with_metadata_options did not get added until 57.1.0. You can see the initial clippy failure here: https://github.com/apache/iceberg-rust/actions/runs/20211830111/job/58018793697#step:4:854

Given this, I am fine if you'd prefer to just close this PR for now. I assume upgrading Arrow also isn't a preferred solution for such a minor PR.

Also, sorry for forgetting to update the PR comment with these details!

[liurenjie1024]

Thanks @lgingerich , I prefer to wait for next round upgrading of arrow to add this change.

[lgingerich]

Sounds good, will close this.