Skip to content

[Minor] document edge case of updateFunc usage#18088

Closed
emilyselwood wants to merge 2 commits intoapache:masterfrom
emilyselwood:note-edge-case-in-docs
Closed

[Minor] document edge case of updateFunc usage#18088
emilyselwood wants to merge 2 commits intoapache:masterfrom
emilyselwood:note-edge-case-in-docs

Conversation

@emilyselwood
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Include documentation of the fact that the updateFunc is sometimes called with no new values. This is documented in the main documentation here: https://spark.apache.org/docs/latest/streaming-programming-guide.html#updatestatebykey-operation however from the docs included with the code it is not clear that this is the case.

How was this patch tested?

PR only changes comments. Confirmed code still builds.

Copy link
Copy Markdown
Member

@srowen srowen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe that's correct.

Copy link
Copy Markdown
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds it changes the permission from ...

-rw-r--r--  ... PairDStreamFunctions.scala

to an executable ...

-rwxr-xr-x   ... PairDStreamFunctions.scala*

@emilyselwood
Copy link
Copy Markdown
Contributor Author

Good catch @HyukjinKwon Sorry about that.

@SparkQA
Copy link
Copy Markdown

SparkQA commented May 26, 2017

Test build #3762 has finished for PR 18088 at commit ed8cdb7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Copy Markdown
Member

srowen commented May 26, 2017

Merged to master

@asfgit asfgit closed this in b6f2017 May 26, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants