Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Oct 27, 2025

What changes were proposed in this pull request?

This PR aims to use Apache Spark 4.1.0-preview3 in the following test pipelines.

  • integration-test-token
  • integration-test-mac-spark41

Why are the changes needed?

To update the test coverage with the latest Apache Spark 4.1.0-preview3.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun dongjoon-hyun marked this pull request as draft October 27, 2025 16:30
@peter-toth
Copy link

There seem to be many failures in CI.

@dongjoon-hyun dongjoon-hyun marked this pull request as ready for review October 27, 2025 21:43
@dongjoon-hyun
Copy link
Member Author

Thank you, @viirya and @peter-toth .

I regenerated the Swift code from 4.1.0-preview3 in the following PR. For Spark Data Pipeline changes, we will catch up soon.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-54042 branch October 27, 2025 21:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants