Add release notes for 0.246 by caithagoras · Pull Request #15602 · prestodb/presto

caithagoras · 2021-01-11T17:34:25Z

Missing Release Notes

Bhavani Hari

Add release notes for 0.245 #15499 Add release notes for 0.245 (Merged by: Wenlei Xie)

Emy Sun

Port reverse(varbinary) from Prestosql to Prestodb #15508 Port reverse(varbinary) from Prestosql to Prestodb (Merged by: Rongrong Zhong)

George Wang

Avoid planning unnecessary LIMIT/TopN/Sort/DistinctLimit #14915 Avoid planning unnecessary LIMIT/TopN/Sort/DistinctLimit (Merged by: Rebecca Schlussel)
Avoid planning unnecessary LIMIT/TopN/Sort/DistinctLimit #14915 Avoid planning unnecessary LIMIT/TopN/Sort/DistinctLimit (Merged by: Rebecca Schlussel)

shenh062326

d2cb24c Fix temporary table deletion for exchange materialization

Extracted Release Notes

Only allow constants for prepared statement parameters #15322 (Author: Rebecca Schlussel): Only allow constants for prepared statement parameters
- Fix an issue where prepared statements would allow some non-constant parameters.
Only allow constants for prepared statement parameters #15322 (Author: Rebecca Schlussel): Only allow constants for prepared statement parameters
- Fix an issue where prepared statements would allow some non-constant parameters.
Ensure nullable partitioning column is handled properly #15470 (Author: George Wang): Ensure nullable partitioning column is handled properly
- Fix dynamic pruning failures for joining on null keys in hive partition.
Disallow ORDER BY literal in window functions #15485 (Author: Sreeni Viswanadha): Disallow ORDER BY literal in window functions
- Disallow ORDER BY literals used with Window functions as it's not useful, expensive and most often used wrongly.
Inject null provider when thrift execution is not needed #15501 (Author: Rongrong Zhong): Inject null provider when thrift execution is not needed
- Fix injection issue when using function namespace manager.
Add listener model for TaskThresholdMemoryRevokingScheduler #15505 (Author: Saksham Sachdev): Add listener model for TaskThresholdMemoryRevokingScheduler
- Add listener-based revocation model for spilling strategy PER_TASK_MEMORY_THRESHOLD.
Split large pages in TempSingleStreamSpiller #15529 (Author: Rebecca Schlussel): Split large pages in TempSingleStreamSpiller
- Fix a possible int overflow error when spilling to temp storage.
Support driver level plan in fragment result caching #15550 (Author: Shixuan Fan): Support driver level plan in fragment result caching
- Support fragment result caching for queries with local exchange (e.g. intermediate aggregation).
Support driver level plan in fragment result caching #15550 (Author: Shixuan Fan): Support driver level plan in fragment result caching
- Support fragment result caching for queries with local exchange (e.g. intermediate aggregation).
Fix QualifiedObjectName instantiation in FunctionAndTypeManager #15555 (Author: Rongrong Zhong): Fix QualifiedObjectName instantiation in FunctionAndTypeManager
- Fix a bug introduced in :pr:15313 that would cause queries to fail when using upper case in SQL function catalog schema names.
Upgrade JTS to 1.18.0 #15560 (Author: James Gill): Upgrade JTS to 1.18.0
- Upgrade JTS to 1.18.0.
Require min 30s query.min-expire-age #15585 (Author: Ariel Weisberg): Require min 30s query.min-expire-age
- Add 30 second minimum to query.min-expire-age configuration parameter.
Disable spill for probe only grouped execution #15592 (Author: Rebecca Schlussel): Disable spill for probe only grouped execution
- Disable spill to disk for join queries where the probe side uses grouped execution and the build does not. Previously these queries would fail with generic_internal_errors.

All Commits

dc00b9f Disable spill for probe only grouped execution (Rebecca Schlussel)
8148cb3 Dereference SerializedPageReferences in batches (James Petty)
7ce6c1f Avoid unnecessary synchronization in LazyOutputBuffer (James Petty)
ca94665 Add listener model for TaskThresholdMemoryRevokingScheduler (Saksham Sachdev)
ca7610b Require min 30s query.min-expire-age (Ariel Weisberg)
ab78e27 Fix SliceDirectSelectiveStreamReader for ARRAY of VARCHAR (Ying Su)
c3d0a4d Fix testSubfieldValue in OrcTester (Ying Su)
27fc29b Limit batch read mode to certain conditions for SliceDirectSelectiveStreamReader (Ying Su)
70f379d Fix SliceDirectSelectiveStreamReader for dataLength is 0 (Ying Su)
18cbfa7 Extract assertBlockEquals() in OrcTester (Ying Su)
6f4e444 Upgrade JTS to 1.18.0 (James Gill)
cebe0c2 Store manifest only when they are preferred and file renaming is enabled (Nikhil Collooru)
aa1fd64 Track compressed manifest size when file_renaming is enabled (Nikhil Collooru)
6a47cf2 Add containsNumberedFileNames to PartitionUpdate (Nikhil Collooru)
f538920 Fix sorting file names for bucketed splits (Nikhil Collooru)
effd0ea Disallow ORDER BY literal (ordinal) in window functions as this may be a misunderstood feature. (Sreeni Viswanadha)
844dbeb Avoid planning unnecessary Sort (George Wang)
90cd1d0 Avoid planning unnecessary LIMIT/TopN/Sort/DistinctLimit (George Wang)
b1846c1 Support driver level plan in fragment result caching (Shixuan Fan)
b950aec Remove unused method in LocalExecutionPlanner (Shixuan Fan)
8a00581 Provide more detail in MULTI_CATALOG_WRITE_CONFLICT (Wenlei Xie)
abdbd68 Fix javadoc method reference (James Petty)
13be472 Fix typo in ConcurrentHashMap creation (James Petty)
f5a5af4 Avoid repeatedly setting memory limits in QueryContext (James Petty)
1bb85b0 Fix QualifiedObjectName instantiation in FunctionAndTypeManager (Rongrong Zhong)
f31b960 Minor fix to Hive temporary table location (Wenlei Xie)
adc7a64 Avoid costly resizes of the addresses dynamic array in PagesIndex (Andrii Rosa)
9dd4b77 Remove redundant setter in TestHiveClientConfig (Shixuan Fan)
8d6ac0e Reuse decompression buffer between multiple OrcInputStream's (Andrii Rosa)
47a39d4 Shrink cached buffers in OrcInputStream (Andrii Rosa)
69b12d3 Improve OrcInputStream memory tracking (Andrii Rosa)
839007f Upgrade Drift to 1.32 (Andrii Rosa)
bb3a2b7 Add PrestoThriftPage (Rongrong Zhong)
7561c12 Add flag to set cache eviction retries (Bin Fan)
7f3e694 Improve error handling for spill (Rebecca Schlussel)
6d77b0a Make AbstractTestXQueries classes abstract (Rebecca Schlussel)
28f787b Add config to stop installation of disabled connectors (Saksham Sachdev)
a68b96b Split large pages in TempSingleStreamSpiller (Rebecca Schlussel)
ab243b6 Refactor JoinBridgeProvider (Rebecca Schlussel)
a2939dc Make getExpectedOrdersTableDescription protected (Rohit Jain)
382c83d Revert "Fix temporary table deletion for exchange materialization" (Wenlei Xie)
cfe9642 Replace Joda-Time libraries with java.time in Presto MongoDB (Sorin Stoiana)
7726215 Refactor AbstractTestQueryFramework to supply expectedQueryRunner (John Roll)
1acb585 Release notes for 0.244.1 (Bhavani Hari)
d2cb24c Fix temporary table deletion for exchange materialization (shenh062326)
25c03cc Fix accidental per-instance logger in SerializedPageWriteListener (James Petty)
a4d7abd Set broadcast memory limit for Presto on Spark (Vic Zhang)
3feecf3 Fix broadcast memory update in RootAggregatedMemoryContext (Vic Zhang)
4d5afce Support Serialized Presto Page in Thrift UDF service (Rongrong Zhong)
b49294b Move BlockEncodingManager to presto-common (Rongrong Zhong)
b3d92fc Remove redundant code in EchoFirstInputThriftUdfService (Rongrong Zhong)
8bea180 Prefer default parallelism to avoid adding extra local exchange (Andrii Rosa)
1eb7024 Support different concurrency settings for table writer (Andrii Rosa)
b7d1a76 Add reverse function for varbinary (Emy Sun)
22efd1a Deprecating Joda library in Presto Cassandra (Moji Solgi)
222b0df Inject null provider when thrift execution is not needed (Rongrong Zhong)
60f4d68 Fix incompatible reflection for modifying static final fields since JDK 12 (fornaix)
bf7bec4 handle nulls properly in flatmap reader (Zhenyuan Zhao)
9b3690a Clean up parameters related code (Rebecca Schlussel)
457aa86 Only allow constants in prepared statement parameters (Rebecca Schlussel)
729554d Fix dynamic pruning for null keys in hive partition (George Wang)
6913ec9 Minor fix for memory property removal in Presto verifier (Wenlei Xie)

linux-foundation-easycla · 2021-01-11T17:34:29Z

The committers are authorized under a signed CLA.

✅ Costin (6e7a2b2b6a5beb5cd2cff16e1c1526073090fc35)

rschlussel · 2021-01-12T16:46:39Z

Additional release notes for me:
Optimize queries that have unnecessary limits and order bys. This feature is enabled by default and can be disabled by using the configuration property optimizer.skip-redundant-sort or session property skip_redundant_sort.

presto-docs/src/main/sphinx/release/release-0.246.rst

rschlussel · 2021-01-22T16:58:45Z

presto-docs/src/main/sphinx/release/release-0.246.rst

What does this mean from a user perspective @rongrong?

This comment has not been addressed yet.

It means if user use function namespace manager presto server might fail to start failing with injection error.

rschlussel · 2021-01-22T16:59:38Z

presto-docs/src/main/sphinx/release/release-0.246.rst

remove duplicate note?

rschlussel · 2021-01-22T16:59:59Z

presto-docs/src/main/sphinx/release/release-0.246.rst

What does this mean? Is there anything the user needs to do to enable this feature?

Guideline for the start of the line: https://github.com/prestodb/presto/wiki/Release-Notes-Guidelines#order-of-changes.

We should rephrase to

Add support ...

rschlussel · 2021-01-26T14:39:43Z

@rongrong i think we're still missing a release note for "#15508 Port reverse(varbinary) from Prestosql to Prestodb (Merged by: Rongrong Zhong)"

rschlussel · 2021-01-26T14:41:49Z

@caithagoras can't add you as a reviewer because the PR is under your name, but the release notes are ready for review.

caithagoras · 2021-01-26T19:16:27Z

presto-docs/src/main/sphinx/release/release-0.246.rst

* Add a minimum value of 30 seconds to the configuration property ``query.min-expire-age``.

caithagoras · 2021-01-26T19:17:40Z

presto-docs/src/main/sphinx/release/release-0.246.rst

Guideline for the start of the line: https://github.com/prestodb/presto/wiki/Release-Notes-Guidelines#order-of-changes.

We should rephrase to

Add support ...

caithagoras · 2021-01-26T19:17:55Z

presto-docs/src/main/sphinx/release/release-0.246.rst

double back quotes. Please also update everywhere else in the doc for keywords.

``ORDER BY``

caithagoras · 2021-01-26T19:19:21Z

presto-docs/src/main/sphinx/release/release-0.246.rst

Remove extra whitespace.

``GENERIC_INTERNAL_ERRORS``

caithagoras · 2021-01-26T19:19:52Z

presto-docs/src/main/sphinx/release/release-0.246.rst

Add a period (".") at the end of the line.

back quote properties

caithagoras · 2021-01-26T19:20:17Z

presto-docs/src/main/sphinx/release/release-0.246.rst

We should rephrase to

Improve ...

caithagoras · 2021-01-26T19:21:29Z

presto-docs/src/main/sphinx/release/release-0.246.rst

Let's include all changes that starts with "Add" and "Improve".

I don't think there is anything that major. lets remove this section for this release

mayankgarg1990 · 2021-01-26T20:29:47Z

presto-docs/src/main/sphinx/release/release-0.246.rst

int -> integer, temp -> temporary

mayankgarg1990 · 2021-01-26T20:30:26Z

presto-docs/src/main/sphinx/release/release-0.246.rst

what does this mean - can the author clarify this ?

mayankgarg1990 · 2021-01-26T20:31:46Z

presto-docs/src/main/sphinx/release/release-0.246.rst

back quote properties

mayankgarg1990 · 2021-01-26T20:32:24Z

presto-docs/src/main/sphinx/release/release-0.246.rst

I don't think there is anything that major. lets remove this section for this release

rschlussel · 2021-01-26T21:46:56Z

@cocozianu can you squash all the commits together?

caithagoras · 2021-01-27T00:28:44Z

Please squash all commits into 1. We don't use multiple commits for retaining history.

https://thoughtbot.com/blog/git-interactive-rebase-squash-amend-rewriting-history

rschlussel reviewed Jan 22, 2021

View reviewed changes

rschlussel requested review from mayankgarg1990 and tdcmeehan January 26, 2021 14:38

caithagoras commented Jan 26, 2021

View reviewed changes

mayankgarg1990 suggested changes Jan 26, 2021

View reviewed changes

cocozianu force-pushed the release-notes-0.246 branch from 1c8ab8c to 4426a4d Compare January 27, 2021 01:35

Add release notes for 0.246

65d4746

cocozianu force-pushed the release-notes-0.246 branch from 4426a4d to 65d4746 Compare January 27, 2021 02:03

rongrong approved these changes Jan 27, 2021

View reviewed changes

caithagoras merged commit 19c78fb into prestodb:master Jan 27, 2021

Conversation

caithagoras commented Jan 11, 2021 • edited by wenleix Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Missing Release Notes

Bhavani Hari

Emy Sun

George Wang

shenh062326

Extracted Release Notes

All Commits

Uh oh!

linux-foundation-easycla bot commented Jan 11, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

rschlussel commented Jan 12, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rschlussel commented Jan 26, 2021

Uh oh!

rschlussel commented Jan 26, 2021

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rschlussel commented Jan 26, 2021

Uh oh!

caithagoras commented Jan 27, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

caithagoras commented Jan 11, 2021 •

edited by wenleix

Loading

linux-foundation-easycla bot commented Jan 11, 2021 •

edited

Loading

rschlussel commented Jan 12, 2021 •

edited

Loading

caithagoras commented Jan 27, 2021 •

edited

Loading