Skip to content

Add release notes for 0.216#12194

Merged
mbasmanova merged 1 commit intoprestodb:masterfrom
mbasmanova:release-notes-0.216
Jan 24, 2019
Merged

Add release notes for 0.216#12194
mbasmanova merged 1 commit intoprestodb:masterfrom
mbasmanova:release-notes-0.216

Conversation

@mbasmanova
Copy link
Contributor

@mbasmanova mbasmanova commented Jan 8, 2019

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what used to happen and what happens now?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sopel39 Karol, could you help answer Rebecca's question?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think it's super clear what "predicate pushdown" means. I think it would be clearer to say Push filters on window function partition symbols below window operators. (I assume that's what this is about)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We shouldn't mention "partition symbols" at all since that is an internal detail of the planner. This should be explained in end-user terms.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe add that SHOW STATS FOR should be used instead

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, it looks like we put SQL syntax in code backticks. so that should be done here too (or removed at show create table. whichever is our standard practice)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please put code, SQL stuff in double backticks. There are other places that need to be updated.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also need a . at the end.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clarify that it's pushed down to the connector. We sometimes use "pushed down" to mean pushed down within the plan and sometimes pushed down to the connector.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need a . at the end.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

set the configuration property (add "the")

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

surround "run-teardown-on-result-mismatch" with double backticks like the other configuration properties

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add ``run-teardown-on-result-mismatch`` config property. ...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

temporary tables (plural)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"rare (but practical)" doesn't mean a whole lot to me. Get rid of those words.

@mbasmanova mbasmanova force-pushed the release-notes-0.216 branch from a9f3c5c to 2762328 Compare January 8, 2019 20:16
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should put parquet related docs under Hive Changes.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Put optimize_mixed_distinct_aggregation in double backticks.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please put code, SQL stuff in double backticks. There are other places that need to be updated.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need a . at the end.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also need a . at the end.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add support for predicate pushdown for columns with ``char(x)`` type.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add ``run-teardown-on-result-mismatch`` config property. ...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there a doc that we can link to here for reduce_agg?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nezihyigitbasi @wenleix Currently, there is not. Wenlei will be adding one.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should add the documentation before releasing. The code should not have been merged without documentation.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to get in #12195.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fix the rendering of live plan view for ...

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nezihyigitbasi This way is it not clear what was wrong? Whether the UI didn't look nice or it failed to render at all.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The ... in the end means the rest is the same, sorry for the confusion.

Fix the rendering of live plan view for queries involving index joins (:issue:`12054 `)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we still want to go one level deeper in terms of detail, we can also add what exactly is broken with rendering.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@nezihyigitbasi Updated

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Return final results to clients immediately for failed queries.

@mbasmanova mbasmanova force-pushed the release-notes-0.216 branch from 2762328 to 844c200 Compare January 8, 2019 21:39
@mbasmanova
Copy link
Contributor Author

@nezihyigitbasi @rschlussel Nezih, Rebecca, thank you for reviews. I made the changes you suggested. Would you take another look?

@mbasmanova mbasmanova force-pushed the release-notes-0.216 branch from 844c200 to 96e2f50 Compare January 8, 2019 22:22
Copy link
Contributor

@rschlussel rschlussel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A couple additional comments.

Copy link
Contributor

@nezihyigitbasi nezihyigitbasi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding some more comments.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need double backticks around count(*) as * will make the rest of the sentence italic.

``count(*)``

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does "fix" mean? Did it fail during planning? Return an incorrect result?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sopel39 Karol, could you answer David's question?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe:

Do not return ``NULL`` as ``count(*)`` aggregation result when ``optimize_mixed_distinct_aggregation`` is enabled.

?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This release note item is talking in terms of the plan tree. Can we make it more user friendly?
We should say something like Add an optimizer rule to filter the window partitions before executing the window operators. Please check with the author of this change if this statement is correct.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sopel39 Karol, could you review the proposed wording?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Much better, thanks!

Copy link
Contributor

@electrum electrum left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In addition to comments, this needs the additional release notes that were recently added to the release notes issue

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What does "fix" mean? Did it fail during planning? Return an incorrect result?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should add the documentation before releasing. The code should not have been merged without documentation.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is an implementation detail and should not be a release note item. If there is a user visible change, such as allowing connecting to Kudu servers newer than version X, then mention that directly.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kokosing Grzegorz, is there any user-visible change?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SPI Changes

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@mbasmanova mbasmanova force-pushed the release-notes-0.216 branch 2 times, most recently from 16c2284 to 1a3c056 Compare January 18, 2019 20:16
@mbasmanova
Copy link
Contributor Author

@rschlussel @nezihyigitbasi @electrum Comments addressed. Please take another look.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to get in #12195.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mbasmanova please fix the issue link as commented above.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add ``number_of_replicas`` table property to ...

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the same as another item above.

* Improve performance for :func:`array_intersect`.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When I build the release notes this item gets rendered like below, which is not what we want.

Add support for Amazon S3 Configuration, which enables pushing down projections and predicates into S3 for text files.

To fix this we can provide a custom text for the link:

:ref:`S3 select pushdown <s3selectpushdown>`

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be removed since we are reverting the change

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

remove "the" and change to "structured" to "structural"

Is this an engine change that applies to all connectors?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CC: @yingsu00 Ying, "Is this an engine change that applies to all connectors?"

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@mbasmanova These are array function changes in the engine, and it should apply to all connectors.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this an engine change that applies to all connectors?

I think this could be mine. Originally it was: Improve performance of table scan on structured types by removing unnecessary memory accounting.

Yes. this applies to all connectors

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Remove "the"

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Link to the function and move above to be with the other optimizations

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change SHOW STATS here to be a link so that it is consistent with the one above. Or change the one above to be text.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be removed as we are reverting this change

@mbasmanova
Copy link
Contributor Author

@nezihyigitbasi @electrum Nezih, David, thank you for reviewing. Comments addressed.

Copy link
Contributor

@nezihyigitbasi nezihyigitbasi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM with two changes:

  • We need the reduce_agg doc (#12195) merged and update the release notes to refer to it.
  • Remove the SPI Changes as that change is reverted (790f4af)

@mbasmanova
Copy link
Contributor Author

@nezihyigitbasi Thank you, Nezih. Addressed all comments.

@mbasmanova mbasmanova merged commit 868c9f3 into prestodb:master Jan 24, 2019
@mbasmanova mbasmanova deleted the release-notes-0.216 branch February 15, 2019 16:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants