Skip to content

Releases: memiiso/debezium-server-iceberg

Release latest

17 Jul 08:12
1eab9c0
Compare
Choose a tag to compare
Release latest Pre-release
Pre-release

Release latest

Release 0.5.0.Beta

28 Jun 14:17
2957e3b
Compare
Choose a tag to compare

Release 0.5.0.Beta

Breaking Changes

Debezium version upgraded from 2.5.x to 2.7.x:

IcebergSchemaHistory wrong table location corrected:

IcebergSchemaHistory class was using wrong table namespace {catalog-name}.{table-name} now this is corrected to use {table-namespace}.{table-name}
If you were using different catalog-name please follow following steps for migration

  1. stop debezium server
  2. copy the IcebergSchemaHistory table to new location: {table-namespace}.{table-name}
  3. start debezium server

Configuration change:

Configuration option debezium.sink.iceberg.upsert-op-column, defaultValue = __op is removed.

Notable changes

  • Quarkus upgraded from 3.6.x to 3.10.x, See Quarkus release notes here
  • Java release target upgraded from 11 to 17
  • Full support for debezium nested events added. Now its possible to run consumer without event flattening.
  • Debezium event processing improved, unnecessary schema de-serialization is avoided.

What's Changed

Full Changelog: 0.4.0.Final...0.5.0.Beta

Release 0.4.1.Final

29 May 19:15
c9c4ce2
Compare
Choose a tag to compare

This release includes fix to debezium storage classes {IcebergSchemaHistory, IcebergOffsetBackingStore}. Now both classes can be used by icebergevents consumer too.

Breaking Changes

IcebergSchemaHistory class was using wrong table name {catalog-name}.{table-name} now this is corrected to {table-namespace}.{table-name}
If you were using different catalog-name previously please follow following steps for migration

  1. stop debezium server
  2. move the table to new location: {table-namespace}.{table-name}
  3. start the debezium server

What's Changed

  • Simplify example config, removed hadoop catalog example by @ismailsimsek in #321
  • Fix reading config values in debezium storage classes by @ismailsimsek in #327
  • Minor improvements to icebergevents consumer, IcebergEventsChangeCons… by @ismailsimsek in #328

Release 0.4.0.Final

02 May 19:59
14b2158
Compare
Choose a tag to compare

Release 0.4.0.Final

What's Changed

Full Changelog: 0.3.0.Final...0.4.0.Final

Release 0.4.0.Beta

03 Mar 21:39
0d5e9ce
Compare
Choose a tag to compare

This release includes dependency upgrades and improvements with dependency versions.

Breaking Changes

Removed iceberg-spark-runtime-* dependency from the release in #114

Debezium version upgraded from 2.2.1 to 2.5.2
For Debezium 2.2 Breaking Changes please see release notes
For Debezium 2.3 Breaking Changes please see release notes
For Debezium 2.4 Breaking Changes please see release notes
For Debezium 2.5 Breaking Changes please see release notes

Iceberg upgraded from 1.3.x to 1.5.0
For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 3.3.2 to 3.6.9
For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

New Contributors

Full Changelog: 0.3.0.Beta...0.4.0.Beta

Release 0.3.0.Final

03 Mar 22:42
0d5e9ce
Compare
Choose a tag to compare

Release 0.3.0.Final

Breaking Changes

Iceberg upgraded from 1.3.1 to 1.4.3
For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 3.3.2 to 3.5.3
For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

New Contributors

Full Changelog: 0.3.0.Beta...0.3.0.Final

Release 0.3.0.Beta

09 Sep 22:18
6fa7a25
Compare
Choose a tag to compare

This release includes major features and changes

Notable changes

  • Support for all nested data types added in #232 #233
  • New iceberg offset and database history classes added in #174 #175

Notable PRs

  • Convert __source_ts_ms and __ts_ms to TimestampType.withZone type in #108
  • Add ofset storage class in #174
  • Add iceberg schema history storage in #175
  • Remove aws-java-sdk-bundle from release in #204
  • Add hive-metastore and Iceberg cloud dependencies to release in #198
  • Add support to map data type in #232 #233

Breaking Changes

  • aws-java-sdk-bundle dependency removed from the release in #204
  • __source_ts_ms and __ts_ms fields are converted to TimestampType.withZone type in #108

Debezium version upgraded from 1.9.5.Final to 2.2.1.Final
For Debezium 1.9 Breaking Changes please see release notes
For Debezium 2.0 Breaking Changes please see release notes
For Debezium 2.1 Breaking Changes please see release notes
For Debezium 2.2 Breaking Changes please see release notes

Iceberg upgraded from 0.14.0 to 1.3.1
For Iceberg changes please see https://iceberg.apache.org/releases/

Quarkus upgraded from 2.11.3.Final to 3.3.2
For Quarkus changes please see https://quarkus.io/blog/tag/release/

What's Changed

Read more

Release 0.2.0.Final

05 Sep 15:31
debc790
Compare
Choose a tag to compare

Release 0.2.0.Final

What's Changed

New Contributors

Full Changelog: 0.2.0.Beta...0.2.0.Final

Release 0.2.0.Beta

08 Jan 11:28
087da65
Compare
Choose a tag to compare

New features since 0.1.0.Alpha

  • Enable automatic field addition to support schema evolution #74
  • Support writing partitioned iceberg tables #71
  • Add support for array data type #63
  • Improving documentation #61
  • Update distribution to include oracle and db2 connectors #60
  • add Dockerfile and release image to github container registry #53
  • Support all iceberg file formats parquet,orc,avro #46
  • Support nested data types #41
  • Add batch size wait to optimize batch size by monitoring debezium queue size #16

Full Release History

What's Changed

New Contributors

Full Changelog: 0.1.0.Alpha...0.2.0.Beta

Release 0.1.0.Alpha

23 Apr 20:21
Compare
Choose a tag to compare

Release 0.1.0.Alpha

New Features:

  • Iceberg append, upsert modes
  • Dynamic batch size control