Zeppelin-275: Add SpringXD Stream and Job Interpreters

[tzolov]

1. SpringXD Stream Interpreter:

• %xd.stream - identifies the SpringXD Streams interpreter.
• Use (Ctrl+.) for auto-completion.
• Streams must have names. Follow the convention: (stream name = stream definition). Streams without names are ignored.
• New Run destroys any previous streams created in the same paragraph. The previous streams are destroyed even if their names have been changed or removed.
• New Run will Create and automatically Deploy all streams defined in the Paragraph.
• If one stream fails to create or deploy all streams in the paragraph are destroyed
• Zeppelin returns after the streams deployment (e.g. Zeppelin goes into Finished state).
• When streams have successfully been deployed the result contains a button that lists the just deployed streams and status 'DEPLOYED'
• To destroy streams in the paragraph press the Annular button in the result section. Button state should switch from 'DEPLOYED' to 'DESTROYED'.
• Streams can refer other streams or jobs in any paragraph and even different notebooks

2. SpringXD Job Interpreter:

• %xd.job - identifies the SpringXD Job interpreter.
• Use (Ctrl+.) for auto-completion.
• Jobs must have names. Follow the convention: (job name = job definition). Streams without names are ignored.
• New Run destroys any previous jobs created in the same paragraph. The previous jobs are destroyed even if their names have been changed or removed.
• New Run will Create and automatically Deploy and Start all jobs defined in the Paragraph.
• If one job deployment fail all jobs in the paragraph are destroyed
• Zeppelin returns after the jobs have started (e.g. Zeppelin goes into Finished state).
• When job have successfully been deployed the result contains a button that lists the just deployed jobs and status 'DEPLOYED'
• To destroy all jobs in the paragraph, press the Annular button in the result section. Button state should switch from 'DEPLOYED' to 'DESTROYED'.
• Jobs can refer other streams or jobs in any paragraph and even different notebooks

[bzz]

Looks like this guy diverged from master as well as having some commits that are not part of ZEPPELIN-275

[tzolov]

Good spot @bzz, I will try to clear the ghost commits.

[tzolov]

@bzz, i've resolved the commits mix-up, please review.
Also i've rebased the ZEPPELIN-275 branch to the master.

[bzz]

Great!
Quick question - do we need to add this interpreters to the list of interpreters in docs? (They now live in master, under ./docs)

Also, as they become part of releases - are there any new dependency that it brings, that need to be added to zeppelin-distribution/src/bin_license/LICENSE ?

[tzolov]

• Sure the interpreter should have documentation - I will add such to the ./docs
• The interpreter brings 2 deps: spring-xd-rest-client (under Apache2 License) which i will add to the LICENSE file and Guava - already there

[bzz]

Sounds great, thank you very much!

On Sat, Jan 16, 2016 at 3:14 AM, Christian Tzolov [email protected]
wrote:

• Sure the interpreter should have documentation - I will add such to
  the ./docs
• The interpreter brings 2 deps: spring-xd-rest-client (under Apache2
  License) which i will add to the LICENSE file and Guava - already there

—
Reply to this email directly or view it on GitHub
#291 (comment)
.

Kind regards,
Alexander.

[tzolov]

Cheers @bzz,
I've updated the LICENSE file with the springxd dependecy. Also i've put together a basic springxd documentation page and listed it in the interpreter's menu. Let me know if we are still missing tasks.

[AhyoungRyu]

I think that back quotation marks are not working in the table tag. Like this below image.

So, why don't you use <code> tag instead of the back quotations? : )

[tzolov]

Thanks @AhyoungRyu! I've just commited a fix for the abovementioned misspellings.

[bzz]

Were == and < intentionally added here?

[bzz]

Looks great to me, thank you! Just needed to be updated on top of the latest master.

[corneadoug]

@tzolov @bzz
Do we want to rebase and try to merge this PR?