Skip to content

Document Master URL format in high availability set up #17584

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
MirrorZ wants to merge 2 commits into from
Closed

Document Master URL format in high availability set up #17584

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
029f61f
Document Master URL format in high availability set up
MirrorZ Apr 10, 2017
67221f7
zookeeper -> Zookeeper
MirrorZ Apr 10, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions docs/submitting-applications.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -143,6 +143,9 @@ The master URL passed to Spark can be in one of the following formats:
<tr><td> <code>spark://HOST:PORT</code> </td><td> Connect to the given <a href="spark-standalone.html">Spark standalone
cluster</a> master. The port must be whichever one your master is configured to use, which is 7077 by default.
</td></tr>
<tr><td> <code>spark://HOST1:PORT1,HOST2:PORT2</code> </td><td> Connect to the given <a href="spark-standalone.html#standby-masters-with-zookeeper">Spark standalone
Copy link
Copy Markdown
Member

@srowen srowen Apr 10, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

zookeeper -> Zookeeper
Isn't this already documented then? I get that sometimes it's useful o doc something two places but I wonder if this is just redundant.

Copy link
Copy Markdown
Contributor Author

@MirrorZ MirrorZ Apr 10, 2017

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I came across a situation where the developers using the spark driver believed that it was not possible to accept hosts in the mentioned format because it wasn't mentioned in the docs, so I found it useful to add the detail and submit a PR.
Cheers!

cluster with standby masters with Zookeeper</a>. The list must have all the master hosts in the high availability cluster set up with Zookeeper. The port must be whichever each master is configured to use, which is 7077 by default.
</td></tr>
<tr><td> <code>mesos://HOST:PORT</code> </td><td> Connect to the given <a href="running-on-mesos.html">Mesos</a> cluster.
The port must be whichever one your is configured to use, which is 5050 by default.
Or, for a Mesos cluster using ZooKeeper, use <code>mesos://zk://...</code>.
Expand Down