Skip to content

Conversation

@prasadwagle
Copy link

The Zeppelin scalding interpreter is used to
create notebooks and visualizations with scalding code.

Given below is a skeleton of the code. ZeppelinScaldingShell is a subclass of BaseScaldingShell and getRepl is similar to process except that it returns a ScaldingILoop instead of calling repl.process.
out = new ByteArrayOutputStream();
PrintWriter printWriter = new PrintWriter(out, true);
ScaldingILoop interpreter = ZeppelinScaldingShell.getRepl(args, printWriter);
interpreter.createInterpreter();
res = interpreter.intp().interpret(code); // code is received from the web browser
output = out.toString(); // this is sent to the web browser

The ZeppelinScaldingShell.getRepl method needs scaldingREPL to be protected and storedHdfsMode to be public.

@johnynek johnynek merged commit f112d37 into twitter:develop May 31, 2016
@johnynek
Copy link
Collaborator

Thanks! Would love to see a blog post on using Zepplin with scalding.

@sriramkrishnan
Copy link
Collaborator

Not quite a blog post, but not sure if you have seen this - https://zeppelin.incubator.apache.org/docs/0.5.6-incubating/interpreter/scalding.html

@prasadwagle
Copy link
Author

The zeppelin pull request was merged this morning. I put together a draft blog post -https://medium.com/@prasadwagle/apache-zeppelin-scalding-interpreter-ae3f749a32e3#.pqsvmk4nd. Can you please send me your feedback?

@gerashegalov
Copy link
Contributor

“-libjars directory/:directory/”
Did you mean a sequence of directories directory1, directory2?

Note that libjars is a comma-separated list of globs. A single-file-path glob file is resolved to itself. A single directory path is equivalent to the glob directory/*

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants