Add Trino 445 release notes

[colebow]

Description

Assemble the release notes for the upcoming Trino 445 release.

Verification for each pull request

Format: PR/issue number, ✅ / ❌ rn ✅ / ❌ docs
✅ rn - release note added and verified, or assessed to be not necessary, set to ❌ rn before completion
✅ docs - need for docs assessed and merged, or assessed to be not necessary, set to ❌ docs before completion

3 April 2024

• Implement statistical aggregation pushdown for Snowflake connector #21384 ✅ rn ✅ docs
• Make ColumnMapping constructor private #21386 ✅ rn ✅ docs
• Remove deprecated constructors from DriverConnectionFactory #21385 ✅ rn ✅ docs
• Improve AggregationMaskCompiler tests with dictionary blocks #21383 ✅ rn ✅ docs

4 April 2024

• Support creating view with properties in parser #21205 ✅ rn ✅ docs
• Update SDKs + flyway + mongodb #21388 ✅ rn ✅ docs
• Minor code cleanup #21389 ✅ rn ✅ docs
• Enable time type test for Snowflake connector #21390 ✅ rn ✅ docs
• Avoid SELECT * in base JDBC query builder #21051 ✅ rn ✅ docs
• Convert selected classes to records #21400 ✅ rn ✅ docs
• Optimize timestamptz queries in PostgreSQL and MySQL connectors #21244 ✅ rn ✅ docs
• Update httpcore to 4.4.16 #21403 ✅ rn ✅ docs
• Fix invalid javadocs #21382 ✅ rn ✅ docs
• Remove duplicate doc and clarify JDBC vs REST #21379 ✅ rn ✅ docs
• Add table_changes test for replaced tables #20200 ✅ rn ✅ docs

5 April 2024

• Restore QueryId to two access control checks #21374 ✅ rn ✅ docs
• Require deprecation annotation on deprecated methods #21411 ✅ rn ✅ docs
• Fix spelling in JDBC doc #21415 ✅ rn ✅ docs
• Create test namespaces with correct location #21417 ✅ rn ✅ docs
• Avoid endless loop on EventDrivenTaskSource #20982 ✅ rn ✅ docs
• Enable couple well-meaning error-prone checkers  #21419 ✅ rn ✅ docs
• Fix flaky TestFileSingleStreamSpiller test #21424 ✅ rn ✅ docs
• Improve grammar for ALTER TABLE docs #21427 ✅ rn ✅ docs
• Enable additional error-prone checks for tests #21423 ✅ rn ✅ docs
• Convert Symbol to a record #21381 ✅ rn ✅ docs
• Update MySQL image to current oldest available on RDS #21430 ✅ rn ✅ docs
• Drop testing with unsupported Redis version #21431 ✅ rn ✅ docs

6 April 2024

• Use double checked lock in getBufferBlockedFuture to reduce congestion #21418 ✅ rn ✅ docs
• Fix GroupedInOut estimatedSizeOf method definition #21425 ✅ rn ✅ docs
• CI workflow cleanup #21432 ✅ rn ✅ docs
• Update MySQL tested version #21433 ✅ rn ✅ docs
• Update airlift to 244 #21437 ✅ rn ✅ docs
• Add explicit location for the cloned table #21434 ✅ rn ✅ docs
• Update google-libraries to 26.37.0 #21439 ✅ rn ✅ docs

8 Apri 2024

• Remove deprecated arguments from Hive flush_metadata_cache #21410 ✅ rn ✅ docs
• Remove long deprecated configs #21444 ✅ rn ✅ docs
• Fix testConvertComparison test in TestPostgreSqlClient #21446 ✅ rn ✅ docs
• Remove redundant version definition #21452 ✅ rn ✅ docs
• Update Redis version requirement #21455 ✅ rn ✅ docs
• Ignore PRs with stale-ignore label #21454 ✅ rn ✅ docs
• TableFunctionDataProcessor javadoc fixes #21453 ✅ rn ✅ docs
• Prune system.metadata.materialized_views columns #21448 ✅ rn ✅ docs
• Rename config classes to match convention #21447 ✅ rn ✅ docs
• Consolidate HDFS file system docs #21245 ✅ rn ✅ docs
• Specify schema name in Snowflake testInformationSchemaFiltering #21459 ✅ rn ✅ docs

9 April 2024

• Update Alluxio to 312 #21462 ✅ rn ✅ docs
• Fail Driver on exception from processNewSources #21397 ✅ rn ✅ docs
• Exclude files that do not satisfy the metadata predicate #17693 ✅ rn ✅ docs
• Add support for time travel with version in Delta Lake #21052 ✅ rn ✅ docs
• Lazy computation of some fields in QueryMetadata and QueryStatistics #21445 ✅ rn ✅ docs
• Fix threads leak in SqlTaskManager #21466 ✅ rn ✅ docs
• Fix flakiness of testDeletionVectorsAbsolutePath test #21456 ✅ rn ✅ docs
• Block task execution on catalog loading flag #21252 ✅ rn ✅ docs
• Deprecate iceberg.materialized-views.hide-storage-table #21485 ✅ rn ✅ docs

10 April 2024

• Closing binder cleanup #21477 ✅ rn ✅ docs
• Remove deprecated legacy materialized view grace period config property #21474 ✅ rn ✅ docs
• Fix synchronization in SPI, client, plugin toolkit, filesystem-exchange #21483 ✅ rn ✅ docs
• Fix InternalResourceGroup synchronization #21484 ✅ rn ✅ docs
• Fix thread leaks in Hive, Iceberg, Delta and Hudi connectors #21490 ✅ rn ✅ docs
• Terminate WorkerDynamicCatalogManager's executor #21491 ✅ rn ✅ docs
• Reduce generated code size for Row Constructors #21299 ✅ rn ✅ docs
• Update maven plugins to support reproducible builds #21493 ✅ rn ✅ docs
• Reference an existing file in the vale sample command #21495 ✅ rn ✅ docs
• Iceberg handles cleanup #21473 ✅ rn ✅ docs
• JDBC handles cleanup #21481 ✅ rn ✅ docs
• Retain authorization header during cross host client redirects #21203 ✅ rn ✅ docs
• Stop listing files when exact checkpoint found in Delta Lake time travel #21486 ✅ rn ✅ docs
• Preserve order of evaluation of filters that may fail #21429 ❌ rn ✅ docs
• Fix incorrect derivation of effective predicate #21494 ✅ rn ✅ docs
• Check table existence in Trino instead of Cassandra #21504 ✅ rn ✅ docs
• Remove JUnit 4 from FTE tests #21499 ✅ rn ✅ docs
• Delta handles cleanup #21497 ✅ rn ✅ docs
• Elasticsearch handles cleanup #21500 ✅ rn ✅ docs
• Iceberg handles cleanup #21498 ✅ rn ✅ docs
• Remove deprecated TransactionLogAccess.loadSnapshot #21505 ✅ rn ✅ docs
• Update AWS SDK v1 to 1.12.698 #21478 ✅ rn ✅ docs

11 April 2024

• Avoid hard-coded region name in tests #21503 ✅ rn ✅ docs
• Use default catalog name in TestDeltaLakeRenameToWithGlueMetastore #21501 ✅ rn ✅ docs
• Check synchronization with error-prone #21482 ✅ rn ✅ docs
• Add and use ConnectorSplit.getSplitInfo method #21471 ✅ rn ✅ docs
• Reformat security enums to make them easier to extend #21517 ✅ rn ✅ docs
• Fix TestIcebergStatistics when running locally #21496 ✅ rn ✅ docs
• Make sealed version of Avro Resolver Action #21407 ✅ rn ✅ docs
• Fix incorrect effective predicate derivation for non-equatable type #21519 ✅ rn ✅ docs
• Adjust Iceberg RestCatalog exception handling #21516 ✅ rn ✅ docs
• Adjust DeltaLakeSplitSource error code based on cause #21510 ✅ rn ✅ docs
• Remove retained size from JdbcTypeHandle JSON form #21514 ✅ rn ✅ docs
• Clean up Snowflake type mapping code #21405 ✅ rn ✅ docs
• Fix invalid pushdown of predicate that may fail #21521 ❌ rn ✅ docs
• Make BigQueryColumnHandle record #21525 ✅ rn ✅ docs

12 April 2024

• Fix thread leak in MinioClient #21522 ✅ rn ✅ docs
• Use assertThatThrownBy in testMaxRowsExceedsLimit #21529 ✅ rn ✅ docs
• Fix error message in TrinoRestCatalog.listTables #21531 ✅ rn ✅ docs
• Add QueryTracker stats #21513 ✅ rn ✅ docs
• Test adding field on corrupted Iceberg table #21530 ✅ rn ✅ docs
• Fix element handle type handle #21535 ✅ rn ✅ docs
• Use method reference in testMaxRowsExceedsLimit #21536 ✅ rn ✅ docs
• Fix correctness bug in constant literal distinct aggregation #18566 ✅ rn ✅ docs
• Try reading data from underlying source if the data has been corrupted #21350 ✅ rn ✅ docs
• IR interpreter/optimizer improvements #21274 ✅ rn ✅ docs
• Switch remaining Delta Lake tests to Native FS #21537 ✅ rn ✅ docs

13 April 2024

• Convert table and column handle classes to record in Cassandra #21540 ✅ rn ✅ docs
• Convert table handle classes to record in MongoDB #21539 ✅ rn ✅ docs
• Add support for creating view with properties in engine and hive #21401 ✅ rn ❌ docs
• Convert some classes to record and remove unused class in TPCDS #21551 ✅ rn ✅ docs
• Convert some classes to record in Blackhole connector #21548 ✅ rn ✅ docs
• Convert some classes to record in Memory connector #21547 ✅ rn ✅ docs
• Convert some classes to record in JMX #21546 ✅ rn ✅ docs
• Remove unused HudiInputInfo #21544 ✅ rn ✅ docs
• Convert some classes to record and remove redundant code in Kudu #21545 ✅ rn ✅ docs
• Convert some classes to record in Google Sheets #21543 ✅ rn ✅ docs
• Convert some classes to record in TPCH #21549 ✅ rn ✅ docs
• Convert some classes to record in Redis #21542 ✅ rn ✅ docs
• Convert some classes to record in BigQuery #21541 ✅ rn ✅ docs
• Fix flaky TestCassandraConnectorTest #21552 ✅ rn ✅ docs
• Implement CREATE OR REPLACE TABLE for delta lake connector #19991 ✅ rn ❌ docs

14 April 2024

• Allow creating temp tables for BigQuery materialized views #21487 ✅ rn ✅ docs

15 April 2024

• Update Ailift to 245 #21555 ✅ rn ✅ docs
• Update s3mock-testcontainers to 3.6.0 #21553 ✅ rn ✅ docs
• use bounded executor for the DispatchManager's executor #21228 ✅ rn ❌ docs
• Remove "experimental" from BigQuery Arrow config property #21564 ✅ rn ✅ docs
• Convert DeltaLakeColumnMetadata to record #21565 ✅ rn ✅ docs
• Add documentation for sorted_by table property #21561 ✅ rn ✅ docs

16 April 2024

• Move table function operator to package #21559 ✅ rn ✅ docs
• Add bloom filter write support to ParquetWriter #20662 ✅ rn ✅ docs
• Relax test assertion in BaseOracleFailureRecoveryTest #21571 ✅ rn ✅ docs
• Convert some classes to record in MongoDB #21568 ✅ rn ✅ docs
• Upgrade to localstack 3.3.0 #21449 ✅ rn ✅ docs
• Add mongodb dynamic filter support #21355 ✅ rn ✅ docs
• Fix HiveTableHandle equality #21573 ✅ rn ✅ docs
• Indicate constraint in HiveTableHandle.toString  #21574 ✅ rn ✅ docs
• Close JettyHttpClient in tests #21577 ✅ rn ✅ docs
• Allow using filter when materializing BigQuery views #21488 ✅ rn ✅ docs
• Remove unused benchmarks profile #21579 ✅ rn ✅ docs

17 April 2024

• Update trino-maven-plugin to 14 #21576 ✅ rn ✅ docs
• Replace special $array function with dedicated IR #21566 ✅ rn ✅ docs
• Convert QualifiedObjectName to record #21592 ✅ rn ✅ docs

[mosabua]

Thats a thing?

[hashhar]

please name the functions explicitly since not all statistical aggregation functions are supported.

[mosabua]

Yeah .. also .. did the docs get updated with that PR?

[chenjian2664]

Yes updated. the functions are variance, var_pop,var_samp,covar_pop,covar_samp, corr,regr_intercept,regr_slope

[mosabua]

Awesome @chenjian2664

[ebyhr]

This is wrong. The past versions have already supported reading materialized views.

[mosabua]

Are either @colebow or @ebyhr sending a PR to correct this?