Skip to content

[Doc] Improve Python DataFrame documentation #5287

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
rxin wants to merge 6 commits into from
Closed

[Doc] Improve Python DataFrame documentation #5287

rxin wants to merge 6 commits into from

Conversation

@rxin
Copy link
Contributor

@rxin rxin commented Mar 31, 2015

No description provided.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29470 has started for PR 5287 at commit 608422d.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29470 has finished for PR 5287 at commit 608422d.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class UDFRegistration(object):
    • class DataFrameNaFunctions(object):
    • case class StringStartsWith(attribute: String, value: String) extends Filter
    • case class StringEndsWith(attribute: String, value: String) extends Filter
    • case class StringContains(attribute: String, value: String) extends Filter
  • This patch does not change any dependencies.

@AmplabJenkins
Copy link

AmplabJenkins commented Mar 31, 2015

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29470/
Test FAILed.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29496 has started for PR 5287 at commit b163365.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29496 has finished for PR 5287 at commit b163365.

  • This patch fails PySpark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class UDFRegistration(object):
  • This patch does not change any dependencies.

@AmplabJenkins
Copy link

AmplabJenkins commented Mar 31, 2015

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29496/
Test FAILed.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29501 has started for PR 5287 at commit ac1d4c0.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29501 has finished for PR 5287 at commit ac1d4c0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class UDFRegistration(object):
  • This patch does not change any dependencies.

@AmplabJenkins
Copy link

AmplabJenkins commented Mar 31, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29501/
Test PASSed.

@rxin rxin changed the title [Doc] Cleanup context.py Python docs. [Doc] Improve Python DataFrame documentation Mar 31, 2015
@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29506 has started for PR 5287 at commit bc3b72b.

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29506 has finished for PR 5287 at commit bc3b72b.

  • This patch fails Python style tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class UDFRegistration(object):
  • This patch does not change any dependencies.

@AmplabJenkins
Copy link

AmplabJenkins commented Mar 31, 2015

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29506/
Test FAILed.

@rxin
Copy link
Contributor Author

rxin commented Mar 31, 2015

@davies can you take a look at the changes?

@SparkQA
Copy link

SparkQA commented Mar 31, 2015

Test build #29507 has started for PR 5287 at commit 1841b60.

davies
davies reviewed Apr 1, 2015
View reviewed changes
python/pyspark/sql/dataframe.py
Copy link
Contributor

@davies davies Apr 1, 2015

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add a line to say it will return a DataFrame.

@davies
Copy link
Contributor

davies commented Apr 1, 2015

LGTM, just one minor comment.

@SparkQA
Copy link

SparkQA commented Apr 1, 2015

Test build #29507 has finished for PR 5287 at commit 1841b60.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • class UDFRegistration(object):
  • This patch does not change any dependencies.

@AmplabJenkins
Copy link

AmplabJenkins commented Apr 1, 2015

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/29507/
Test PASSed.

@rxin
Copy link
Contributor Author

rxin commented Apr 1, 2015

I'm going to merge this and will fix the comment in a separate PR.

asfgit pushed a commit that referenced this pull request Apr 1, 2015
@rxin
[Doc] Improve Python DataFrame documentation
e527b35 
Author: Reynold Xin <[email protected]>

Closes #5287 from rxin/pyspark-df-doc-cleanup-context and squashes the following commits:

1841b60 [Reynold Xin] Lint.
f2007f1 [Reynold Xin] functions and types.
bc3b72b [Reynold Xin] More improvements to DataFrame Python doc.
ac1d4c0 [Reynold Xin] Bug fix.
b163365 [Reynold Xin] Python fix. Added Experimental flag to DataFrameNaFunctions.
608422d [Reynold Xin] [Doc] Cleanup context.py Python docs.

(cherry picked from commit 305abe1)
Signed-off-by: Reynold Xin <[email protected]>
@asfgit asfgit closed this in 305abe1 Apr 1, 2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@rxin @SparkQA @AmplabJenkins @davies