Add release notes for 0.257

[ajaygeorge]

Missing Release Notes

Sergey Pershin

• a56c544 Disable flaky test 'testGetQueryInfos'.

Extracted Release Notes

• Supporting instance count in ARRAY_POSITION #15170 (Author: Saumitra Shahapure): Supporting instance count in ARRAY_POSITION
  • Add support for ARRAY_POSITION(array, element, instance).
• Support correlated column mapping type coercion #15575 (Author: George Wang): Support correlated column mapping type coercion
  • Add support for more kinds of correlated subqueries.
• Add support for OFFSET clause #16035 (Author: George Wang): Add support for OFFSET clause
  • Add support for the result offset clause in SQL query expressions. This feature can be enabled by setting the session property offset_clause_enabled or configuration property offset-clause-enabled to true.
• Add support for OFFSET clause #16035 (Author: George Wang): Add support for OFFSET clause
  • Add support for the result offset clause in SQL query expressions. This feature can be enabled by setting the session property offset_clause_enabled or configuration property offset-clause-enabled to true.
• Add support for OFFSET clause #16035 (Author: George Wang): Add support for OFFSET clause
  • Add support for the result offset clause in SQL query expressions. This feature can be enabled by setting the session property offset_clause_enabled or configuration property offset-clause-enabled to true.
• Add support for OFFSET clause #16035 (Author: George Wang): Add support for OFFSET clause
  • Add support for the result offset clause in SQL query expressions. This feature can be enabled by setting the session property offset_clause_enabled or configuration property offset-clause-enabled to true.
• Support multi coordinator while serving resource group info #16205 (Author: Abhisek Gautam Saikia): Support multi coordinator while serving resource group info
  • Support multi coordinator for v1/resourceGroupState/* endpoint.
• Display coordinator host name in web ui #16254 (Author: Abhisek Gautam Saikia): Display coordinator host name in web ui
  • Display coordinator host name in web ui to support multi coordinator setup.
• Reintroduce fix for dynamic pruning for with null keys in hive partition #16261 (Author: James Petty): Reintroduce fix for dynamic pruning for with null keys in hive partition
  • Fix dynamic pruning for null keys in hive partition.
• Reintroduce fix for dynamic pruning for with null keys in hive partition #16261 (Author: James Petty): Reintroduce fix for dynamic pruning for with null keys in hive partition
  • Fix dynamic pruning for null keys in hive partition.
• Fix deadlock in join spilling #16293 (Author: Andrii Rosa): Fix deadlock in join spilling
  • Resolve deadlock problem that results into join + limit getting stuck when spilling is enabled.
• Fix deadlock in join spilling #16293 (Author: Andrii Rosa): Fix deadlock in join spilling
  • Resolve deadlock problem that results into join + limit getting stuck when spilling is enabled.
• Fix deadlock in join spilling #16293 (Author: Andrii Rosa): Fix deadlock in join spilling
  • Resolve deadlock problem that results into join + limit getting stuck when spilling is enabled.
• Create GenericHiveRecordCursor within doAs block to pass the correct credentials to storage #16333 (Author: Chen): Create GenericHiveRecordCursor within doAs block to pass the correct credentials to storage
  • Fix a bug in reading Avro format table with schema located in a Kerberos enabled HDFS compliant filesystem.
• Change RowExpressionFormatter output to be closer to valid SQL #16335 (Author: Seba Villalobos): Change RowExpressionFormatter output to be closer to valid SQL
  • Improved RowExpressionFormatter output to be closer to valid SQL. Constant expressions are now output as TYPE 'value' (e.g. BIGINT'2') using TypeConstructor (with single quotes appearing in the string escaped with ''), with the exception of VARBINARY constants, which use the binary literal syntax (e.g. X'abc123'). LIKE expressions are now output as valid SQL.
• RowExpression duplicate isNull on same variable issue #16336 (Author: Chen): RowExpression duplicate isNull on same variable issue
  • Add support for expressions with multiple IS NULL on the same variable.
• Compact deserialized page in SingleStreamSpiller #16338 (Author: Vic Zhang): Compact deserialized page in SingleStreamSpiller
  • Fix spilled query exceeding local memory limit due to incorrect memory size calculation when spilled data is read by SingleStreamSpiller.
• Fix unspill scheduling in join spill #16339 (Author: Vic Zhang): Fix unspill scheduling in join spill
  • Fix scheduling issue in join spill to improve memory used by unspilled data.

All Commits

• a56c544 Disable flaky test 'testGetQueryInfos'. (Sergey Pershin)
• 4de2228 RowExpression duplicate isNull on same variable issue (Chen)
• 307efd4 Add WarningCollector to QueryPrerequisites (Basar Hamdi Onat)
• bb4b68e Invalidate cache if partition is not present (Rohit Jain)
• 32face2 Add cross join unnest support for materialized view (Rohit Jain)
• 50d9c07 Add option to remove from session properties (Basar Hamdi Onat)
• f6e532f Disable Flaky test (Arjun Gupta)
• d2295a3 Close LocalMemoryContext inside PrestoSparkRemoteSourceOperator (Arjun Gupta)
• fafbefc Support user defined types in FunctionNamespaceManager (Rongrong Zhong)
• 014ba1a Fix to adjusted queue size for multi coordinator (Swapnil Tailor)
• 98cfd41 Fix broadcast table memory accounting bug in PrestoSparkRemoteSourceOperator (Arjun Gupta)
• 42cf2e9 Change RowExpressionFormatter output to be closer to valid SQL (Seba Villalobos)
• e4cd8ea Fixing distinct count pushdown when there are multiple count distinct queries (Xiang Fu)
• 3ef9184 Compact deserialized page in SingleStreamSpiller (Vic Zhang)
• 21d6dd3 Add authentication when creating Hive page source (Chen)
• f50e888 Support multi coordinator while serving resource group info (Abhisek Gautam Saikia)
• c82233e Allow Resource Manager as an active node when NodeStatusService won't allow it (Swapnil Tailor)
• 5c951a9 Fix unspill scheduling in join spill (Vic Zhang)
• cd48fd9 Add session property for partial agg threshold (prithvip)
• 98e0924 Selectively enable partial aggregations based on statistics (prithvip)
• 8a875fa Add session property for partial aggregation strategy (prithvip)
• 667e6f6 Add notion of confidence to PlanNodeStatsEstimate (prithvip)
• a921aa5 Fix the missing table from querying the BigQuery tables (BigQuery connector: error when querying data #16145, NPE when querying tables with BigQuery connector #16178) (George Wang)
• 55126d8 Fix NoClassDefFoundError during presto launch time (BigQuery connector: java.lang.NoClassDefFoundError: com/google/auth/oauth2/QuotaProjectIdProvider when starting presto #16093) (George Wang)
• 6560c80 Centralize Long Type Dictionary Loading Logic (Huameng Jiang)
• a089c10 Support type coercion for correlated column mapping (George Wang)
• 85b2417 Ignore RM from scheduling (Swapnil Tailor)
• 44b7a7b Add DWRF stripe cache support to OrcWriter (Sergii Druzkin)
• b66da38 Create ZOrder library for integers (Grace Xin)
• 87d759c Split Presto on Spark tests into multiple jobs on CI (Andrii Rosa)
• f550783 Readjust concurrency and thread pool settings for Presto on Spark tests (Andrii Rosa)
• 0cd31fc Fix deadlock in join spilling (Andrii Rosa)
• 67646c9 Disable testLimitWithJoin for Presto on Spark (Vic Zhang)
• 2947ece Improve memory for HashBuilderOperator unspill (Vic Zhang)
• 91cf5a0 Skip loading StaticCatalogStore and AccessControlManager for RM (Swapnil Tailor)
• e54bd73 Improve DistinctLimitOperator (James Petty)
• 9dba528 Optimize TupleDomain.columnWiseUnion during dynamic filtering collection (Roman Zeyde)
• 14ad556 Fix iceberg table params dropped after insert (beinan)
• 656d155 Add 'limit' parameter to GET:/v1/query (Sergey Pershin)
• 13a241b Update documentation for OFFSET (George Wang)
• 676a0a5 Support configurable switch offset_clause_enabled for OFFSET (George Wang)
• cf2011e Add OFFSET implementation (George Wang)
• 3cde0e4 Add support for OFFSET syntax in grammar and AST (George Wang)
• 3d262b5 Make DWRF reader fail with verbose error when encounter 2GB+ streams (Sergii Druzkin)
• d31ea9f Add additional query time statistics (tanjialiang)
• 8378094 Supporting instance count in ARRAY_POSITION (Saumitra Shahapure)
• a29bf65 Document SerializedPage wire format (Masha Basmanova)
• 30114f5 Prepare ORC writer API for DWRF stripe cache (Sergii Druzkin)
• a95a2e6 Avoid ambiguous null value encoding in HivePartitionKey (James Petty)
• 998614e Revert "Revert "Fix dynamic pruning for null keys in hive partition"" (James Petty)
• 43a656e Display coordinator host name in web ui (Abhisek Gautam Saikia)
• 033323a Disable TestDistributedClusterStatsResource since it is failing (Mayank Garg)

[ajaygeorge]

@rschlussel / @tdcmeehan can you please take another look. Addressed the comments.

[mayankgarg1990]

Some more changes :)

@rschlussel, @tdcmeehan - a few of these are on top of your recommended suggestions - so it will be great if you can check that they make sense

[ajaygeorge]

Addressed comments
Can you please take another look @rschlussel / @mayankgarg1990 / @tdcmeehan .

[mayankgarg1990]

lgtm