Skip to content

SPARK-5136 [DOCS] Improve documentation around setting up Spark IntelliJ project #3952

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
srowen wants to merge 2 commits into from
Closed

SPARK-5136 [DOCS] Improve documentation around setting up Spark IntelliJ project #3952

Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
016b7df
Point to IntelliJ wiki page instead of also including IntelliJ notes …
srowen Jan 8, 2015
f3baa66
Point to new IJ / Eclipse wiki link
srowen Jan 9, 2015
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion docs/building-spark.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -153,7 +153,8 @@ Thus, the full flow for running continuous-compilation of the `core` submodule m

# Using With IntelliJ IDEA

@pwendell pwendell Jan 9, 2015

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I actually changed the wiki entry a bit. Maybe we could have a header that says

# Building Spark with IntelliJ IDEA or Eclipse

And it could refer to our IDE section:

https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark#ContributingtoSpark-IDESetup

@srowen srowen Jan 9, 2015

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pwendell Done. The other half of this change is then updating the wiki with some additional information. You can see my proposed text above and the tidbits I think should be on the wiki. Feel free to integrate whatever of it you see fit, however you see fit.


This setup works fine in IntelliJ IDEA 11.1.4. After opening the project via the pom.xml file in the project root folder, you only need to activate either the hadoop1 or hadoop2 profile in the "Maven Properties" popout. We have not tried Eclipse/Scala IDE with this.
For additional help in setting up IntelliJ IDEA for Spark development, refer to the

@ryan-williams ryan-williams Jan 8, 2015

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: s/additional //?

[wiki page for IntelliJ](https://cwiki.apache.org/confluence/display/SPARK/Useful+Developer+Tools#UsefulDeveloperTools-BuildingSparkinIntelliJIDEA)

# Building Spark Debian Packages

Expand Down