Getting java.lang.NoSuchMethodError org.apache.iceberg.util.JsonUtil.mapper() With Hive catalog

[ismailsimsek]

Query engine

Java API and Hive Catalog

Question

When using iceberg with Hive catalog getting following error on some environments. The error randomly appears in different environments

Full stack trace and configuration is here memiiso/debezium-server-iceberg#271 (comment)

Producer failure: java.lang.NoSuchMethodError: 'org.apache.iceberg.shaded.com.fasterxml.jackson.databind.ObjectMapper org.apache.iceberg.util.JsonUtil.mapper()'

Original report memiiso/debezium-server-iceberg#271

[nastra]

@ismailsimsek this is typically a sign of mixed dependency versions on the classpath. I think the problem is that Debezium is using Spark 3.3, which requires Jackson 2.13.4 but Debezium uses Jackson 2.14.2.

If you want to use Jackson 2.14.2, then you'd need to upgrade Spark to 3.4.

[nastra]

Additionally, make sure to sync up the AWS SDK version to what the respective Iceberg version is using. The same applies for GCP/Azure dependencies. Otherwise you'll be having the same issue with those dependencies

[ismailsimsek]

Thank you @nastra i will check it

[ismailsimsek]

Fixed memiiso/debezium-server-iceberg#271