You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There might be some times when WIPS spark version need to be run
on EC2 cluster. In order to setup this type of cluster more easily,
add --spark-git-repo option description to ec2 documentation.
Copy file name to clipboardExpand all lines: docs/ec2-scripts.md
+2Lines changed: 2 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -85,6 +85,8 @@ another.
85
85
specified version of Spark. The `<version>` can be a version number
86
86
(e.g. "0.7.3") or a specific git hash. By default, a recent
87
87
version will be used.
88
+
- `--spark-git-repo=<repository url>` enables you to run your development version on EC2 cluster. You need to set`--spark-version`
89
+
as git commit hash such as 317e114 not original release version number. By default, this repository is set [apache mirror](https://github.com/apache/spark).
88
90
- If one of your launches fails due to e.g. not having the right
89
91
permissions on your private key file, you can run `launch` with the
90
92
`--resume` option to restart the setup process on an existing cluster.
0 commit comments