Skip to content

Conversation

@dependabot
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github May 13, 2025

Bumps beam.version from 2.61.0 to 2.65.0.
Updates org.apache.beam:beam-sdks-java-bom from 2.61.0 to 2.65.0

Release notes

Sourced from org.apache.beam:beam-sdks-java-bom's releases.

Beam 2.65.0 Release

We are happy to present the new 2.65.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.65.0, check out the detailed release notes.

Highlights

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348).
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824).
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

... (truncated)

Changelog

Sourced from org.apache.beam:beam-sdks-java-bom's changelog.

[2.65.0] - 2025-05-12

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348)
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824)
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

  • Fixed read Beam rows from cross-lang transform (for example, ReadFromJdbc) involving negative 32-bit integers incorrectly decoded to large integers (#34089)
  • (Java) Fixed SDF-based KafkaIO (ReadFromKafkaViaSDF) to properly handle custom deserializers that extend Deserializer interface(#34505)
  • [Python] TypedDict typehints are now compatible with Mapping and Dict type annotations.

Security Fixes

Known Issues

... (truncated)

Commits
  • ab1feee Set version for 2.65.0 RC2
  • 656e924 Encode paneinfo with PaneInfoCoder. (#34824) (#34864)
  • e7098bd fix: correct spanner column schema type parser (#34868)
  • ca11207 Modify the assert to accept any instance of AvroCoder, including subclasses. ...
  • 998de4f Prism windowed value coder (#34830) (#34842)
  • 398b322 Add name to BQ File Loads lambda to ensure changes are update compatible (#34...
  • 7ca3068 Revert "[ManagedIO] Fail expansion when encountering extra or unknown configu...
  • f7c109d Set Dataflow container to release version.
  • 3a27dfb Adjusting the YAML Kafka Managed I/O compat version (#34790)
  • cfae867 re-introduce the fail fast mechanic with fixes for documented bugs. (#34659)
  • Additional commits viewable in compare view

Updates org.apache.beam:beam-sdks-java-core from 2.61.0 to 2.65.0

Release notes

Sourced from org.apache.beam:beam-sdks-java-core's releases.

Beam 2.65.0 Release

We are happy to present the new 2.65.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.65.0, check out the detailed release notes.

Highlights

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348).
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824).
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

... (truncated)

Changelog

Sourced from org.apache.beam:beam-sdks-java-core's changelog.

[2.65.0] - 2025-05-12

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348)
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824)
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

  • Fixed read Beam rows from cross-lang transform (for example, ReadFromJdbc) involving negative 32-bit integers incorrectly decoded to large integers (#34089)
  • (Java) Fixed SDF-based KafkaIO (ReadFromKafkaViaSDF) to properly handle custom deserializers that extend Deserializer interface(#34505)
  • [Python] TypedDict typehints are now compatible with Mapping and Dict type annotations.

Security Fixes

Known Issues

... (truncated)

Commits
  • ab1feee Set version for 2.65.0 RC2
  • 656e924 Encode paneinfo with PaneInfoCoder. (#34824) (#34864)
  • e7098bd fix: correct spanner column schema type parser (#34868)
  • ca11207 Modify the assert to accept any instance of AvroCoder, including subclasses. ...
  • 998de4f Prism windowed value coder (#34830) (#34842)
  • 398b322 Add name to BQ File Loads lambda to ensure changes are update compatible (#34...
  • 7ca3068 Revert "[ManagedIO] Fail expansion when encountering extra or unknown configu...
  • f7c109d Set Dataflow container to release version.
  • 3a27dfb Adjusting the YAML Kafka Managed I/O compat version (#34790)
  • cfae867 re-introduce the fail fast mechanic with fixes for documented bugs. (#34659)
  • Additional commits viewable in compare view

Updates org.apache.beam:beam-runners-direct-java from 2.61.0 to 2.65.0

Release notes

Sourced from org.apache.beam:beam-runners-direct-java's releases.

Beam 2.65.0 Release

We are happy to present the new 2.65.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.65.0, check out the detailed release notes.

Highlights

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348).
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824).
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

... (truncated)

Changelog

Sourced from org.apache.beam:beam-runners-direct-java's changelog.

[2.65.0] - 2025-05-12

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348)
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824)
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

  • Fixed read Beam rows from cross-lang transform (for example, ReadFromJdbc) involving negative 32-bit integers incorrectly decoded to large integers (#34089)
  • (Java) Fixed SDF-based KafkaIO (ReadFromKafkaViaSDF) to properly handle custom deserializers that extend Deserializer interface(#34505)
  • [Python] TypedDict typehints are now compatible with Mapping and Dict type annotations.

Security Fixes

Known Issues

... (truncated)

Commits
  • ab1feee Set version for 2.65.0 RC2
  • 656e924 Encode paneinfo with PaneInfoCoder. (#34824) (#34864)
  • e7098bd fix: correct spanner column schema type parser (#34868)
  • ca11207 Modify the assert to accept any instance of AvroCoder, including subclasses. ...
  • 998de4f Prism windowed value coder (#34830) (#34842)
  • 398b322 Add name to BQ File Loads lambda to ensure changes are update compatible (#34...
  • 7ca3068 Revert "[ManagedIO] Fail expansion when encountering extra or unknown configu...
  • f7c109d Set Dataflow container to release version.
  • 3a27dfb Adjusting the YAML Kafka Managed I/O compat version (#34790)
  • cfae867 re-introduce the fail fast mechanic with fixes for documented bugs. (#34659)
  • Additional commits viewable in compare view

Updates org.apache.beam:beam-runners-google-cloud-dataflow-java from 2.61.0 to 2.65.0

Release notes

Sourced from org.apache.beam:beam-runners-google-cloud-dataflow-java's releases.

Beam 2.65.0 Release

We are happy to present the new 2.65.0 release of Beam. This release includes both improvements and new functionality. See the download page for this release.

For more information on changes in 2.65.0, check out the detailed release notes.

Highlights

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348).
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824).
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

... (truncated)

Changelog

Sourced from org.apache.beam:beam-runners-google-cloud-dataflow-java's changelog.

[2.65.0] - 2025-05-12

I/Os

  • Upgraded GoogleAdsAPI to v19 for GoogleAdsIO (Java) (#34497). Changed PTransform method from version-specified (v17()) to current() for better backward compatibility in the future.
  • Added support for writing to Pubsub with ordering keys (Java) (#21162)

New Features / Improvements

  • Added support for streaming side-inputs in the Spark Classic runner (#18136).

Breaking Changes

  • [Python] Cloudpickle is set as the default pickle_library, where previously dill was the default in #34695. For known issues, reporting new issues, and understanding cloudpickle behavior refer to #34903.
  • [Python] Reshuffle now preserves PaneInfo, where previously PaneInfo was lost after reshuffle. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34348)
  • [Python] PaneInfo is encoded by PaneInfoCoder, where previously PaneInfo was encoded with FastPrimitivesCoder falling back to PickleCoder. This only affects cases where PaneInfo is directly stored as an element. (#34824)
  • [Python] BigQueryFileLoads now adds a Reshuffle before triggering load jobs. This fixes a bug where there can be data loss in a streaming pipeline if there is a pending load job during autoscaling. To opt out of this change, set the update_compatibility_version to a previous Beam version e.g. "2.64.0". (#34657)
  • [YAML] Kafka source and sink will be automatically replaced with compatible managed transforms. For older Beam versions, streaming update compatiblity can be maintained by specifying the pipeline option update_compatibility_version (#34767).

Deprecations

  • Beam ZetaSQL is deprecated and will be removed no earlier than Beam 2.68.0 (#34423). Users are recommended to switch to Calcite SQL dialect.

Bugfixes

  • Fixed read Beam rows from cross-lang transform (for example, ReadFromJdbc) involving negative 32-bit integers incorrectly decoded to large integers (#34089)
  • (Java) Fixed SDF-based KafkaIO (ReadFromKafkaViaSDF) to properly handle custom deserializers that extend Deserializer interface(#34505)
  • [Python] TypedDict typehints are now compatible with Mapping and Dict type annotations.

Security Fixes

Known Issues

... (truncated)

Commits
  • ab1feee Set version for 2.65.0 RC2
  • 656e924 Encode paneinfo with PaneInfoCoder. (#34824) (#34864)
  • e7098bd fix: correct spanner column schema type parser (#34868)
  • ca11207 Modify the assert to accept any instance of AvroCoder, including subclasses. ...
  • 998de4f Prism windowed value coder (#34830) (#34842)
  • 398b322 Add name to BQ File Loads lambda to ensure changes are update compatible (#34...
  • 7ca3068 Revert "[ManagedIO] Fail expansion when encountering extra or unknown configu...
  • f7c109d Set Dataflow container to release version.
  • 3a27dfb Adjusting the YAML Kafka Managed I/O compat version (#34790)
  • cfae867 re-introduce the fail fast mechanic with fixes for documented bugs. (#34659)
  • Additional commits viewable in compare view

You can trigger a rebase of this PR by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

Note
Automatic rebases have been disabled on this pull request as it has been open for over 30 days.

Bumps `beam.version` from 2.61.0 to 2.65.0.

Updates `org.apache.beam:beam-sdks-java-bom` from 2.61.0 to 2.65.0
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](apache/beam@v2.61.0...v2.65.0)

Updates `org.apache.beam:beam-sdks-java-core` from 2.61.0 to 2.65.0
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](apache/beam@v2.61.0...v2.65.0)

Updates `org.apache.beam:beam-runners-direct-java` from 2.61.0 to 2.65.0
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](apache/beam@v2.61.0...v2.65.0)

Updates `org.apache.beam:beam-runners-google-cloud-dataflow-java` from 2.61.0 to 2.65.0
- [Release notes](https://github.com/apache/beam/releases)
- [Changelog](https://github.com/apache/beam/blob/master/CHANGES.md)
- [Commits](apache/beam@v2.61.0...v2.65.0)

---
updated-dependencies:
- dependency-name: org.apache.beam:beam-sdks-java-bom
  dependency-version: 2.65.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.beam:beam-sdks-java-core
  dependency-version: 2.65.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.beam:beam-runners-direct-java
  dependency-version: 2.65.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.apache.beam:beam-runners-google-cloud-dataflow-java
  dependency-version: 2.65.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file java Pull requests that update java code labels May 13, 2025
@dependabot @github
Copy link
Contributor Author

dependabot bot commented on behalf of github Jul 2, 2025

Superseded by #1002.

@dependabot dependabot bot closed this Jul 2, 2025
@dependabot dependabot bot deleted the dependabot/maven/beam.version-2.65.0 branch July 2, 2025 03:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies Pull requests that update a dependency file java Pull requests that update java code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant