Merge latest release/26.08 into main [skip ci]

[nvliyuan]

Resolves the latest merge conflicts in #15412 after #15423 merged.

Description

Merge the current release/26.08 head into the current main head.

The initial conflicts were the root and Scala 2.13 project versions. Both were resolved by retaining main's 26.10.0-SNAPSHOT version instead of the release branch's 26.08.0-SNAPSHOT version.

The branch was refreshed again after additional PRs landed on release/26.08. The current diff includes all release updates added after #15423, including:

• Preserve BroadcastHashJoin isSkewJoin in GPU plan display [databricks] #15413 — preserve Spark 4.2 BroadcastHashJoin isSkewJoin
• [skip ci] Fix Iceberg REST S3 path regression coverage #15422 — fix Iceberg REST S3 path regression coverage
• Support IF_NOT_CONTAINED filter type and loading inline deletion vectors for OSS delta [databricks] #15368 — OSS Delta deletion-vector updates
• Fix OSS Delta RTAS on Spark 4.x+ [databricks] #15411 — fix OSS Delta RTAS on Spark 4.x+
• Match Spark 4.2 date_trunc overflow at Long.MinValue [databricks] #15416 — match Spark 4.2 date_trunc overflow behavior

Checklists

Documentation

• Updated for new or modified user-facing features or behaviors
• No user-facing change

Testing

• Added or modified tests to cover new code paths
• Covered by existing tests
  (The included release commits retain their original tests.)
• Not required

Performance

• Tests ran and results are added in the PR description
• Issue filed with a link in the PR description
• Not required

Validation

• git diff --check
• Parsed both initially resolved POM files as XML
• python3 -m py_compile for the modified Iceberg, Delta, and date-time integration tests

IMPORTANT: Merge this PR using Create a merge commit so the release commit ancestry is preserved and #15412 can close automatically.

[greptile-apps]

Greptile Summary

This release-branch merge brings Delta Lake, Spark 4.2, Iceberg, and utility updates into main.

• Adds OSS Delta deletion-vector support for retention filters and inline bitmaps across Parquet reader paths.
• Enables GPU Delta replacement-table writes through truncate-capable staged tables and overwrite plan conversion.
• Preserves Spark 4.2 broadcast-hash-join skew metadata and aligns date_trunc overflow behavior.
• Adds Iceberg path-regression coverage and extracts a reusable ByteBufferInputStream.

Confidence Score: 5/5

The PR appears safe to merge.

No blocking failure remains.

Important Files Changed

Filename	Overview
delta-lake/common/src/main/delta-33x-41x/scala/com/nvidia/spark/rapids/delta/common/GpuDeltaParquetFileFormatBase2.scala	Propagates retention-filter semantics and matching alive-row counts consistently through per-file, multithreaded, and coalescing deletion-vector readers.
delta-lake/common/src/main/delta-33x-41x/scala/com/nvidia/spark/rapids/delta/GpuDeltaCatalogBase.scala	Advertises truncate support for staged Delta tables so replacement-table writes can use the overwrite execution path.
sql-plugin/src/main/scala/org/apache/spark/sql/rapids/datetimeExpressions.scala	Routes every timestamp-truncation dispatch shape through version-specific overflow checking while preserving resource cleanup.
sql-plugin/src/main/spark420/scala/com/nvidia/spark/rapids/shims/TruncTimestampShims.scala	Adds Spark 4.2-specific wrapped-result detection for timestamp truncation.
sql-plugin/src/main/spark420/scala/org/apache/spark/sql/rapids/execution/GpuBroadcastHashJoinExec.scala	Preserves Spark 4.2 BroadcastHashJoin skew metadata during GPU conversion.
sql-plugin/src/main/scala/com/nvidia/spark/rapids/ByteBufferInputStream.scala	Introduces a reusable InputStream adapter with standard bounds, zero-length-read, and skip behavior.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  Release["release/26.08 changes"] --> Main["main / 26.10.0-SNAPSHOT"]
  Main --> Delta["Delta deletion vectors and RTAS"]
  Main --> Spark42["Spark 4.2 date_trunc and skew-join shims"]
  Main --> Iceberg["Iceberg S3 path regression coverage"]
  Main --> Utility["ByteBufferInputStream extraction"]

Loading

_{Reviews (3): Last reviewed commit: "Merge branch 'main' into fix-auto-merge-..." | Re-trigger Greptile}

[nvliyuan]

build

[nartal1]

@nvliyuan - I didn't realize the auto-merge from release/26.08 to main is broken. I merged this PR - #15411 on release/26.08. Could you please include that as well in this PR ?
Or is it okay to create another PR to cherry-pick #15411 once this PR is merged?

[nvliyuan]

@nvliyuan - I didn't realize the auto-merge from release/26.08 to main is broken. I merged this PR - #15411 on release/26.08. Could you please include that as well in this PR ?
Or is it okay to create another PR to cherry-pick #15411 once this PR is merged?

Thanks for the heads-up. I refreshed #15434 with the latest release/26.08, so #15411 is now included, along with #15368 and #15416. @GaryShen2008 could you help re-review thx?

[nvliyuan]

build