-
Notifications
You must be signed in to change notification settings - Fork 3.6k
Add 341 release notes #4976
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Add 341 release notes #4976
Changes from all commits
Commits
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,169 @@ | ||
| # Release 341 (8 Sep 2020) | ||
|
|
||
| ## General Changes | ||
|
|
||
| * Add support for variable-precision `TIME` type. ({issue}`4381`) | ||
| * Add support for variable precision `TIME WITH TIME ZONE` type. ({issue}`4905`) | ||
| * Add {doc}`/connector/iceberg`. | ||
| * Add {func}`human_readable_seconds` function. ({issue}`4344`) | ||
| * Add [`reverse()`](function_reverse_varbinary) function for `VARBINARY`. ({issue}`4741`) | ||
| * Add support for {func}`extract` for `timestamp(p) with time zone` with values of `p` other than 3. ({issue}`4867`) | ||
| * Add support for correlated subqueries in recursive queries. ({issue}`4877`) | ||
| * Add [](optimizer_rule_stats) system table. ({issue}`4659`) | ||
| * Report dynamic filters statistics. ({issue}`4440`) | ||
| * Improve query scalability when new nodes are added to cluster. ({issue}`4294`) | ||
| * Improve error message when JSON parsing fails. ({issue}`4616`) | ||
| * Reduce latency when dynamic filtering is in use. ({issue}`4924`) | ||
| * Remove support for political time zones in `TIME WITH TIME ZONE` type. ({issue}`191`) | ||
| * Remove deprecated `reorder_joins` session property. ({issue}`5027`) | ||
| * Remove the `deprecated.legacy-timestamp` configuration property and the `legacy_timestamp` session property. ({issue}`4799`) | ||
| * Change timestamp operations to match the SQL specification. The value of a `TIMESTAMP` | ||
| type is not affected by the session time zone. ({issue}`37`) | ||
| * Preserve precision when applying `AT TIME ZONE` to values of type `TIMESTAMP`. ({issue}`4866`) | ||
| * Fix serialization of `NULL` values in `ROW`, `MAP` and `ARRAY` types for old Presto clients. ({issue}`4778`) | ||
| * Fix failure when aggregation query contains duplicate expressions. ({issue}`4872`) | ||
| * Fix compiler failure when querying timestamps with a precision greater than 6. ({issue}`4824`) | ||
| * Fix parsing failure of timestamps due to daylight saving changes. ({issue}`37`) | ||
| * Fix failure when calling {func}`extract` with `TIMEZONE_HOUR` and `TIMEZONE_MINUTE` for | ||
| `TIMESTAMP WITH TIME ZONE` type. ({issue}`4867`) | ||
| * Fix query deadlock for connectors that wait for dynamic filters. ({issue}`4946`) | ||
| * Fix failure when `TIME` or `TIMESTAMP` subtraction returns a negative value. ({issue}`4847`) | ||
| * Fix failure when duplicate expressions appear in `DISTINCT` clause. ({issue}`4787`) | ||
| * Fix failure for certain join queries during spilling or when available memory is low. ({issue}`4994`) | ||
| * Fix issue where the `query_max_scan_physical_bytes` session property was ignored if | ||
| the `query.max-scan-physical-bytes` configuration property was not defined. ({issue}`5009`) | ||
| * Correctly compute sample ratio when `TABLESAMPLE` is used with a fractional percentage. ({issue}`5074`) | ||
| * Fail queries with a proper error message when `TABLESAMPLE` is used with a non-numeric sample ratio. ({issue}`5074`) | ||
| * Fail with an explicit error rather than `OutOfMemoryError` for certain operations. ({issue}`4890`) | ||
|
|
||
| ## Security Changes | ||
|
|
||
| * Add [Salesforce password authentication](/security/salesforce). ({issue}`4372`) | ||
| * Add support for interpolating [secrets](/security/secrets) into `access-control.properties`. ({issue}`4854`) | ||
| * Only request HTTPS client certificate when certificate authentication is enabled. ({issue}`4804`) | ||
| * Add {doc}`/security/user-mapping` support for uppercasing or lowercasing usernames. ({issue}`4736`) | ||
|
|
||
| ## Web UI | ||
|
|
||
| * Fix display of physical input read time in detailed query view. ({issue}`4962`) | ||
|
|
||
| ## JDBC Driver Changes | ||
|
|
||
| * Implement `ResultSet.getStatement()`. ({issue}`4957`) | ||
martint marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ## BigQuery Connector Changes | ||
|
|
||
| * Add support for hourly partitioned tables. ({issue}`4968`) | ||
| * Redact the value of `bigquery.credentials-key` in the server log. ({issue}`4968`) | ||
|
|
||
| ## Cassandra Connector Changes | ||
|
|
||
| * Map Cassandra `TIMESTAMP` type to Presto `TIMESTAMP(3) WITH TIME ZONE` type. ({issue}`2269`) | ||
|
|
||
| ## Hive Connector Changes | ||
|
|
||
| * Skip stripes and row groups based on timestamp statistics for ORC files. ({issue}`1147`) | ||
| * Skip S3 objects with the `DeepArchive` storage class (in addition to the `Glacier` | ||
| storage class) when `hive.s3.skip-glacier-objects` is enabled. ({issue}`5002`) | ||
| * Use a temporary staging directory for temporary files when writing to sorted bucketed tables. | ||
| This allows using a more efficient file system for temporary files. ({issue}`3434`) | ||
| * Fix metastore cache invalidation for `GRANT` and `REVOKE`. ({issue}`4768`) | ||
| * Add Parquet and RCBinary [configuration properties](hive_configuration_properties) `hive.parquet.time-zone` | ||
| and `hive.rcfile.time-zone` to adjust binary timestamp values to a specific time zone. For Hive 3.1+, this | ||
| should be set to UTC. The default value is the JVM default time zone, for backwards compatibility with | ||
| earlier versions of Hive. ({issue}`4799`) | ||
| * Add ORC [configuration property](hive_configuration_properties) `hive.orc.time-zone` to set the default | ||
| time zone for legacy ORC files that did not declare a time zone. ({issue}`4799`) | ||
| * Replace the `hive.time-zone` configuration property with format specific properties: `hive.orc.time-zone`, | ||
| `hive.parquet.time-zone`, `hive.rcfile.time-zone`. ({issue}`4799`) | ||
| * Allow using the cluster default role with S3 security mapping. ({issue}`4931`) | ||
| * Remove support for bucketing on timestamp. The definition of the hash function for timestamp | ||
| incorrectly depends on the storage time zone and can result in incorrect results. ({issue}`4759`) | ||
| * Decrease the number of requests to the Glue metastore when fetching partitions. | ||
| This helps avoid hitting rate limits and decreases service costs. ({issue}`4938`) | ||
| * Match the existing user and group of the table or partition when creating new files on HDFS. ({issue}`4414`) | ||
| * Fix invalid timestamp values for nested data in Text, Avro, SequenceFile, JSON and CSV formats. ({issue}`4799`) | ||
| * Fix query failure when reading an ORC ACID table with a filter after the table | ||
| underwent a minor table compaction. ({issue}`4622`) | ||
| * Fix incorrect query results when reading an ORC ACID table that has deleted rows | ||
| and underwent a minor compaction. ({issue}`4623`) | ||
| * Fix query failure when storage caching is enabled and cached data is evicted during query execution. ({issue}`3580`) | ||
| * Fix incorrect results when filtering on columns of `TIMESTAMP` type. ({issue}`5083`) | ||
|
|
||
| ## JMX Connector Changes | ||
|
|
||
| * Change `timestamp` column type in history tables to `TIMESTAMP WITH TIME ZONE`. ({issue}`4753`) | ||
|
|
||
| ## Kafka Connector Changes | ||
|
|
||
| * Preserve time zone when parsing `TIMESTAMP WITH TIME ZONE` values. ({issue}`4799`) | ||
|
|
||
| ## Kinesis Connector Changes | ||
|
|
||
| * Preserve time zone when parsing `TIMESTAMP WITH TIME ZONE` values. ({issue}`4799`) | ||
martint marked this conversation as resolved.
Outdated
Show resolved
Hide resolved
|
||
|
|
||
| ## Kudu Connector Changes | ||
|
|
||
| * Fix delete when applied on table having primary key of decimal type. ({issue}`4683`) | ||
|
|
||
| ## Local File Connector Changes | ||
|
|
||
| * Change `timestamp` column type to `TIMESTAMP WITH TIME ZONE`. ({issue}`4752`) | ||
|
|
||
| ## MySQL Connector Changes | ||
|
|
||
| * Improve performance of aggregation queries by pushing the aggregation computation into the MySQL database. | ||
| Currently, the following aggregate functions are eligible for pushdown: `count`, `min`, `max`, | ||
| `sum` and `avg`. ({issue}`4138`) | ||
|
|
||
| ## Oracle Connector Changes | ||
|
|
||
| * Add `oracle.connection-pool.inactive-timeout` configuration property to specify how long | ||
| pooled connection can be inactive before it is closed. It defaults to 20 minutes. ({issue}`4779`) | ||
| * Add support for database internationalization. ({issue}`4775`) | ||
| * Add resilience to momentary connection authentication issues. ({issue}`4947`) | ||
| * Allowing forcing the mapping of certain types to `VARCHAR`. This can be enabled by | ||
| setting the `jdbc-types-mapped-to-varchar` configuration property to a comma-separated | ||
| list of type names. ({issue}`4955`) | ||
| * Prevent query failure for pushdown of predicates involving a large number of conjuncts. ({issue}`4918`) | ||
|
|
||
| ## Phoenix Connector Changes | ||
|
|
||
| * Fix overwriting of former value when insert is applied without specifying that column. ({issue}`4670`) | ||
|
|
||
| ## Pinot Connector Changes | ||
|
|
||
| * Add support for `REAL` and `INTEGER` types. ({issue}`4725`) | ||
| * Add support for functions in pass-through queries. ({issue}`4801`) | ||
| * Enforce a limit on the number of rows fetched from Pinot. This can be configured via the | ||
| `pinot.max-rows-per-split-for-segment-queries` configuration property. ({issue}`4723`) | ||
| * Fix incorrect results for `count(*)` queries. ({issue}`4802`) | ||
| * Fix incorrect results for queries involving {func}`avg` over columns of type `long`, `int`, or `float`. ({issue}`4802`) | ||
| * Fix incorrect results when columns in pass-through query do not match selected columns. ({issue}`4802`) | ||
|
|
||
| ## Prometheus Connector Changes | ||
|
|
||
| * Change the type of the `timestamp` column to `TIMESTAMP(3) WITH TIME ZONE` type. ({issue}`4799`) | ||
|
|
||
| ## PostgreSQL Connector Changes | ||
|
|
||
| * Improve performance of aggregation queries with predicates by pushing the computation | ||
| of both the filtering and aggregations into the PostgreSQL server where possible. ({issue}`4111`) | ||
| * Fix handling of PostgreSQL arrays when `unsupported-type-handling` is set to `CONVERT_TO_VARCHAR`. ({issue}`4981`) | ||
|
|
||
| ## Raptor Connector Changes | ||
|
|
||
| * Remove the `storage.shard-day-boundary-time-zone` configuration property, which was used to work | ||
| around legacy timestamp semantics in Presto. ({issue}`4799`) | ||
|
|
||
| ## Redis Connector Changes | ||
|
|
||
| * Preserve time zone when parsing `TIMESTAMP WITH TIME ZONE` values. ({issue}`4799`) | ||
|
|
||
| ## SPI Changes | ||
|
|
||
| * The `TIMESTAMP` type is encoded as a number of fractional seconds from `1970-01-01 00:00:00` in the proleptic | ||
| Gregorian calendar. This value is no longer adjusted to the session time zone. Timestamps with precision less | ||
| than or equal to 3 are now represented in microseconds. ({issue}`4799`) | ||
| * Remove `isLegacyTimestamp()` from `ConnectorSession`. ({issue}`4799`) | ||
| * Enable connectors to wait for dynamic filters before producing data on worker nodes. ({issue}`3414`) | ||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.