-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Add Trino 411 release notes #16552
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Add Trino 411 release notes #16552
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,145 @@ | ||
| # Release 411 (29 Mar 2023) | ||
|
|
||
| ## General | ||
|
|
||
| * Add spilled data size to query statistics. ({issue}`16442`) | ||
| * Add {func}`sinh` function. ({issue}`16494`) | ||
| * Add {func}`quantile_at_value` function. ({issue}`16736`) | ||
| * Add support for a `GRACE PERIOD` clause in the `CREATE MATERIALIZED VIEW` | ||
| task. For backwards compatibility, the existing materialized views are | ||
| interpreted as having a `GRACE PERIOD` of zero, however, new materialized | ||
| views have an unlimited grace period by default. This is a backwards | ||
| incompatible change, and the previous behavior can be restored with the | ||
| `legacy.materialized-view-grace-period` configuration property or the | ||
| `legacy_materialized_view_grace_period` session property. ({issue}`15842`) | ||
| * Fix potential incorrect query stats when tasks are waiting on running drivers | ||
| to fully terminate. ({issue}`15478`) | ||
| * Add support for specifying the number of nodes that will write data during | ||
| `INSERT`, `CREATE TABLE ... AS SELECT`, or `EXECUTE` queries with the | ||
| `query.max-writer-tasks-count` configuration property. ({issue}`16238`) | ||
| * Improve performance of queries that contain predicates involving the `year` | ||
| function. ({issue}`14078`) | ||
| * Improve performance of queries that contain a `sum` aggregation. ({issue}`16624`) | ||
| * Improve performance of `filter` function on arrays. ({issue}`16681`) | ||
| * Reduce coordinator memory usage. ({issue}`16668`, {issue}`16669`) | ||
| * Reduce redundant data exchanges for queries with multiple aggregations. ({issue}`16328`) | ||
| * Fix incorrect query results when using `keyvalue()` methods in the | ||
| [JSON path](json-path-language). ({issue}`16482`) | ||
| * Fix potential incorrect results in queries involving joins and a | ||
| non-deterministic value. ({issue}`16512`) | ||
| * Fix potential query failure when exchange compression is enabled. ({issue}`16541`) | ||
| * Fix query failure when calling a function with a large number of parameters. ({issue}`15979`) | ||
|
|
||
| ## BigQuery connector | ||
|
|
||
| * Fix failure of aggregation queries when executed against a materialized view, | ||
| external table, or snapshot table. ({issue}`15546`) | ||
|
|
||
| ## Delta Lake connector | ||
|
|
||
| * Add support for inserting into tables that have | ||
| [simple invariants](https://github.com/delta-io/delta/blob/master/PROTOCOL.md#column-invariants). ({issue}`16136`) | ||
| * Add [generated column expressions](https://docs.delta.io/latest/delta-batch.html#use-generated-columns) | ||
| to the `Extra` column in the results of `DESCRIBE` and `SHOW COLUMNS`. ({issue}`16631`) | ||
| * Expand the `flush_metadata_cache` table procedure to also flush the internal | ||
| caches of table snapshots and active data files. ({issue}`16466`) | ||
| * Collect statistics for newly-created columns. ({issue}`16109`) | ||
| * Remove the `$data` system table. ({issue}`16650`) | ||
| * Fix query failure when evaluating a `WHERE` clause on a partition column. ({issue}`16388`) | ||
|
|
||
| ## Druid connector | ||
|
|
||
| * Fix failure when the query passed to the `query` table function contains a | ||
| column alias. ({issue}`16225`) | ||
|
|
||
| ## Elasticsearch connector | ||
|
|
||
| * Remove the deprecated pass-through query, which has been replaced with the | ||
| `raw_query` table function. ({issue}`13050`) | ||
|
|
||
| ## Hive connector | ||
|
|
||
| * Add a native OpenX JSON file format reader and writer. These can be disabled | ||
| with the `openx_json_native_reader_enabled` and | ||
| `openx_json_native_writer_enabled` session properties or the | ||
| `openx-json.native-reader.enabled` and `openx-json.native-writer.enabled` | ||
| configuration properties. ({issue}`16073`) | ||
| * Add support for implicit coercions between `char` types of different lengths. ({issue}`16402`) | ||
| * Improve performance of queries with joins where both sides of a join have keys | ||
| with the same table bucketing definition. ({issue}`16381`) | ||
| * Improve query planning performance for queries scanning tables with a large | ||
| number of columns. ({issue}`16203`) | ||
| * Improve scan performance for `COUNT(*)` queries on row-oriented formats. ({issue}`16595`) | ||
| * Ensure the value of the `hive.metastore-stats-cache-ttl` configuration | ||
| property always is greater than or equal to the value specified in the | ||
| `hive.metastore-cache-ttl` configuration property. ({issue}`16625`) | ||
| * Skip listing Glue metastore tables with invalid column types. ({issue}`16677`) | ||
| * Fix query failure when a file that is using a text file format with a | ||
| single header row that is large enough to be split into multiple files. ({issue}`16492`) | ||
| * Fix potential query failure when Kerberos is enabled and the query execution | ||
| takes longer than a Kerberos ticket's lifetime. ({issue}`16680`) | ||
|
|
||
| ## Hudi connector | ||
|
|
||
| * Add a `$timeline` system table which can be queried to inspect the Hudi table | ||
| timeline. ({issue}`16149`) | ||
|
|
||
| ## Iceberg connector | ||
|
|
||
| * Add a `migrate` procedure that converts a Hive table to an Iceberg table. ({issue}`13196`) | ||
| * Add support for materialized views with a freshness grace period. ({issue}`15842`) | ||
| * Add a `$refs` system table which can be queried to inspect snapshot | ||
| references. ({issue}`15649`) | ||
| * Add support for creation of materialized views partitioned with a temporal | ||
| partitioning function on a `timestamp with time zone` column. ({issue}`16637`) | ||
| * Improve performance of queries run after data was written by Trino. ({issue}`15441`) | ||
| * Remove the `$data` system table. ({issue}`16650`) | ||
| * Fix failure when the `$files` system table contains non-null values in the | ||
| `key_metadata`, `split_offsets`, and `equality_ids` columns. ({issue}`16473`) | ||
| * Fix failure when partitioned column names contain uppercase characters. ({issue}`16622`) | ||
|
|
||
| ## Ignite connector | ||
|
|
||
| * Add support for predicate pushdown with a `LIKE` clause. ({issue}`16396`) | ||
| * Add support for pushdown of joins. ({issue}`16428`) | ||
| * Add support for {doc}`/sql/delete`. ({issue}`16720`) | ||
|
|
||
| ## MariaDB connector | ||
|
|
||
| * Fix failure when the query passed to the `query` table function contains a | ||
| column alias. ({issue}`16225`) | ||
|
|
||
| ## MongoDB connector | ||
|
|
||
| * Fix incorrect results when the query passed to the MongoDB `query` table | ||
| function contains helper functions such as `ISODate`. ({issue}`16626`) | ||
|
|
||
| ## MySQL connector | ||
|
|
||
| * Fix failure when the query passed to the `query` table function contains a | ||
| column alias. ({issue}`16225`) | ||
|
|
||
| ## Oracle connector | ||
|
|
||
| * Improve performance of queries when the network latency between Trino and | ||
| Oracle is high, or when selecting or when selecting a small number of rows. ({issue}`16644`) | ||
|
|
||
| ## PostgreSQL connector | ||
|
|
||
| * Improve performance of queries when the network latency between Trino and | ||
| PostgreSQL is high, or when selecting or when selecting a small number of rows. ({issue}`16644`) | ||
|
|
||
| ## Redshift connector | ||
|
|
||
| * Improve performance of queries when the network latency between Trino and | ||
| Redshift is high, or when selecting or when selecting a small number of rows. ({issue}`16644`) | ||
|
|
||
| ## SingleStore connector | ||
|
|
||
| * Fix failure when the query passed to the `query` table function contains a | ||
| column alias. ({issue}`16225`) | ||
|
|
||
| ## SQL Server connector | ||
|
|
||
| * Add support for executing stored procedures using the `procedure` table | ||
| function. ({issue}`16696`) | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.