Skip to content

Conversation

@sarutak
Copy link
Member

@sarutak sarutak commented Dec 24, 2014

At the section "Specifying the Hadoop Version" In building-spark.md, there is description about building with YARN with Hadoop 0.23.
Spark 1.3.0 will not support Hadoop 0.23 so we should fix the description.

@sarutak sarutak changed the title [SPARK-4953] Fix the description of building Spark with YARN [SPARK-4953][Doc] Fix the description of building Spark with YARN Dec 24, 2014
@SparkQA
Copy link

SparkQA commented Dec 24, 2014

Test build #24769 has finished for PR 3787 at commit 264e4e0.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not only applicable to CDH 5+, so I'd revert that addition. What was removed with yarn-alpha was not really "Hadoop 0.23" support, although it kind of lines up with that. Why not remove this whole qualifying "For Apache Hadoop ..." phrase altogether? Also, do you mean Spark 1.2? what are you referring to in 1.3 otherwise?

@SparkQA
Copy link

SparkQA commented Dec 24, 2014

Test build #24771 has finished for PR 3787 at commit 9ab0c24.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
    • case class ApplicationFinished(id: String)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This has a typo in "CDEH" and are also not runnable. I don't see much value in elaborating this example 3 more times.

(As a related aside, I would like to see less, not more, vendor stuff in Spark anyway. Adding just this text unduly favors Cloudera a tiny bit; the alternative is to write a bunch of other vendor combos here, which is going to turn into at least a maintenance headache. I already disagree with maintaining vendor versioning info in the project POM.)

@SparkQA
Copy link

SparkQA commented Dec 24, 2014

Test build #24783 has finished for PR 3787 at commit ee9c355.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@pwendell
Copy link
Contributor

This looks good - thanks @sarutak and @srowen!

@asfgit asfgit closed this in 11dd993 Dec 25, 2014
@sarutak sarutak deleted the SPARK-4953 branch April 11, 2015 05:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants