Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
102 changes: 50 additions & 52 deletions site/docs/releases.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,67 +72,65 @@ Apache Iceberg 1.5.0 was released on March 11, 2024.
The 1.5.0 release adds a variety of new features and bug fixes.

* API
- Extend FileIO and add EncryptingFileIO. ([\#9592](https://github.com/apache/iceberg/pull/9592))
- Track partition statistics in TableMetadata ([\#8502](https://github.com/apache/iceberg/pull/8502))
- Add sqlFor API to views to handle resolving a representation for a dialect([\#9247](https://github.com/apache/iceberg/pull/9247))
- Extend FileIO and add EncryptingFileIO. ([\#9592](https://github.com/apache/iceberg/pull/9592))
- Track partition statistics in TableMetadata ([\#8502](https://github.com/apache/iceberg/pull/8502))
- Add sqlFor API to views to handle resolving a representation for a dialect([\#9247](https://github.com/apache/iceberg/pull/9247))
* Core
- Add view support for REST catalog ([\#7913](https://github.com/apache/iceberg/pull/7913))
- Add view support for JDBC catalog ([\#9487](https://github.com/apache/iceberg/pull/9487))
- Add catalog type for glue,jdbc,nessie ([\#9647](https://github.com/apache/iceberg/pull/9647))
- Support Avro file encryption with AES GCM streams ([\#9436](https://github.com/apache/iceberg/pull/9436))
- Add ApplyNameMapping for Avro ([\#9347](https://github.com/apache/iceberg/pull/9347))
- Add StandardEncryptionManager ([\#9277](https://github.com/apache/iceberg/pull/9277))
- Add REST catalog table session cache ([\#8920](https://github.com/apache/iceberg/pull/8920))
- Support view metadata compression ([\#8552](https://github.com/apache/iceberg/pull/8552))
- Track partition statistics in TableMetadata ([\#8502](https://github.com/apache/iceberg/pull/8502))
- Enable column statistics filtering after planning ([\#8803](https://github.com/apache/iceberg/pull/8803))
- Add view support for REST catalog ([\#7913](https://github.com/apache/iceberg/pull/7913))
- Add view support for JDBC catalog ([\#9487](https://github.com/apache/iceberg/pull/9487))
- Add catalog type for glue,jdbc,nessie ([\#9647](https://github.com/apache/iceberg/pull/9647))
- Support Avro file encryption with AES GCM streams ([\#9436](https://github.com/apache/iceberg/pull/9436))
- Add ApplyNameMapping for Avro ([\#9347](https://github.com/apache/iceberg/pull/9347))
- Add StandardEncryptionManager ([\#9277](https://github.com/apache/iceberg/pull/9277))
- Add REST catalog table session cache ([\#8920](https://github.com/apache/iceberg/pull/8920))
- Support view metadata compression ([\#8552](https://github.com/apache/iceberg/pull/8552))
- Track partition statistics in TableMetadata ([\#8502](https://github.com/apache/iceberg/pull/8502))
- Enable column statistics filtering after planning ([\#8803](https://github.com/apache/iceberg/pull/8803))
* Spark
- Remove support for Spark 3.2 ([\#9295](https://github.com/apache/iceberg/pull/9295))
- Support views via SQL for Spark 3.4 and 3.5 ([\#9423](https://github.com/apache/iceberg/pull/9423), [\#9421](https://github.com/apache/iceberg/pull/9421), [\#9343](https://github.com/apache/iceberg/pull/9343)), ([\#9513](https://github.com/apache/iceberg/pull/9513), ([\#9582](https://github.com/apache/iceberg/pull/9582)
- Support executor cache locality ([\#9563](https://github.com/apache/iceberg/pull/9563))
- Added support for delete manifest rewrites ([\#9020](https://github.com/apache/iceberg/pull/9020))
- Support encrypted output files ([\#9435](https://github.com/apache/iceberg/pull/9435))
- Add Spark UI metrics from Iceberg scan metrics ([\#8717](https://github.com/apache/iceberg/pull/8717))
- Parallelize reading files in add_files procedure ([\#9274](https://github.com/apache/iceberg/pull/9274))
- Support file and partition delete granularity ([\#9384](https://github.com/apache/iceberg/pull/9384))
- Remove support for Spark 3.2 ([\#9295](https://github.com/apache/iceberg/pull/9295))
- Support views via SQL for Spark 3.4 and 3.5 ([\#9423](https://github.com/apache/iceberg/pull/9423), [\#9421](https://github.com/apache/iceberg/pull/9421), [\#9343](https://github.com/apache/iceberg/pull/9343)), ([\#9513](https://github.com/apache/iceberg/pull/9513), ([\#9582](https://github.com/apache/iceberg/pull/9582)
- Support executor cache locality ([\#9563](https://github.com/apache/iceberg/pull/9563))
- Added support for delete manifest rewrites ([\#9020](https://github.com/apache/iceberg/pull/9020))
- Support encrypted output files ([\#9435](https://github.com/apache/iceberg/pull/9435))
- Add Spark UI metrics from Iceberg scan metrics ([\#8717](https://github.com/apache/iceberg/pull/8717))
- Parallelize reading files in add_files procedure ([\#9274](https://github.com/apache/iceberg/pull/9274))
- Support file and partition delete granularity ([\#9384](https://github.com/apache/iceberg/pull/9384))
* Flink
- Remove Flink 1.15
- Adds support for 1.18 version [\#9211](https://github.com/apache/iceberg/pull/9211)
- Emit watermarks from the IcebergSource ([\#8553](https://github.com/apache/iceberg/pull/8553))
- Watermark read options ([\#9346](https://github.com/apache/iceberg/pull/9346))
- Remove Flink 1.15
- Adds support for 1.18 version [\#9211](https://github.com/apache/iceberg/pull/9211)
- Emit watermarks from the IcebergSource ([\#8553](https://github.com/apache/iceberg/pull/8553))
- Watermark read options ([\#9346](https://github.com/apache/iceberg/pull/9346))
* Parquet
- Support reading INT96 column in row group filter ([\#8988](https://github.com/apache/iceberg/pull/8988))
- Add system config for unsafe Parquet ID fallback. ([\#9324](https://github.com/apache/iceberg/pull/9324))
- Support reading INT96 column in row group filter ([\#8988](https://github.com/apache/iceberg/pull/8988))
- Add system config for unsafe Parquet ID fallback. ([\#9324](https://github.com/apache/iceberg/pull/9324))
* Kafka-Connect
- Initial project setup and event data structures ([\#8701](https://github.com/apache/iceberg/pull/8701))
- Sink connector with data writers and converters ([\#9466](https://github.com/apache/iceberg/pull/9466))
- Initial project setup and event data structures ([\#8701](https://github.com/apache/iceberg/pull/8701))
- Sink connector with data writers and converters ([\#9466](https://github.com/apache/iceberg/pull/9466))
* Spec
- Add partition stats spec ([\#7105](https://github.com/apache/iceberg/pull/7105))
- add nanosecond timestamp types ([\#8683](https://github.com/apache/iceberg/pull/8683))
- Add multi-arg transform ([\#8579](https://github.com/apache/iceberg/pull/8579))
- Add partition stats spec ([\#7105](https://github.com/apache/iceberg/pull/7105))
- add nanosecond timestamp types ([\#8683](https://github.com/apache/iceberg/pull/8683))
- Add multi-arg transform ([\#8579](https://github.com/apache/iceberg/pull/8579))
* Vendor Integrations
- AWS: Support setting description for Glue table ([\#9530](https://github.com/apache/iceberg/pull/9530))
- AWS: Update S3FileIO test to run when CLIENT_FACTORY is not set ([\#9541](https://github.com/apache/iceberg/pull/9541))
- AWS: Add S3 Access Grants Integration ([\#9385](https://github.com/apache/iceberg/pull/9385))
- AWS: Glue catalog strip trailing slash on DB URI ([\#8870](https://github.com/apache/iceberg/pull/8870))
- Azure: Add FileIO that supports ADLSv2 storage ([\#8303](https://github.com/apache/iceberg/pull/8303))
- Azure: Make ADLSFileIO implement DelegateFileIO ([\#8563](https://github.com/apache/iceberg/pull/8563))
- Nessie: Support views for NessieCatalog ([\#8909](https://github.com/apache/iceberg/pull/8909))
- Nessie: Strip trailing slash for warehouse location ([\#9415](https://github.com/apache/iceberg/pull/9415))
- Nessie: Infer default API version from URI ([\#9459](https://github.com/apache/iceberg/pull/9459))
- AWS: Support setting description for Glue table ([\#9530](https://github.com/apache/iceberg/pull/9530))
- AWS: Update S3FileIO test to run when CLIENT_FACTORY is not set ([\#9541](https://github.com/apache/iceberg/pull/9541))
- AWS: Add S3 Access Grants Integration ([\#9385](https://github.com/apache/iceberg/pull/9385))
- AWS: Glue catalog strip trailing slash on DB URI ([\#8870](https://github.com/apache/iceberg/pull/8870))
- Azure: Add FileIO that supports ADLSv2 storage ([\#8303](https://github.com/apache/iceberg/pull/8303))
- Azure: Make ADLSFileIO implement DelegateFileIO ([\#8563](https://github.com/apache/iceberg/pull/8563))
- Nessie: Support views for NessieCatalog ([\#8909](https://github.com/apache/iceberg/pull/8909))
- Nessie: Strip trailing slash for warehouse location ([\#9415](https://github.com/apache/iceberg/pull/9415))
- Nessie: Infer default API version from URI ([\#9459](https://github.com/apache/iceberg/pull/9459))
* Dependencies
- Bump Nessie to 0.77.1
- Bump ORC to 1.9.2
- Bump Arrow to 15.0.0
- Bump AWS Java SDK to 2.24.5
- Bump Azure Java SDK to 1.2.20
- Bump Google cloud libraries to 26.28.0

Note:
1. To enable view support for JDBC catalog, configure `jdbc.schema-version` to `V1` in catalog properties.
- Bump Nessie to 0.77.1
- Bump ORC to 1.9.2
- Bump Arrow to 15.0.0
- Bump AWS Java SDK to 2.24.5
- Bump Azure Java SDK to 1.2.20
- Bump Google cloud libraries to 26.28.0

* Note: To enable view support for JDBC catalog, configure `jdbc.schema-version` to `V1` in catalog properties.

For more details, please visit Github.
https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.5.0
For more details, please visit [Github](https://github.com/apache/iceberg/releases/tag/apache-iceberg-1.5.0).

## Past releases

Expand Down