[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR #4

jongyoul · 2015-03-26T08:31:05Z

Removed SPARK_YARN_JAR dependencies

jongyoul · 2015-03-26T08:35:28Z

@Leemoonsoo This PR is related #2 . I removed SPARK_YARN_JAR dependencies. After you merge #2 , I'll fix the docs.

jongyoul · 2015-03-27T02:35:48Z

I've rebased this from current master to update README.md. @Leemoonsoo Review this PR, please.

Leemoonsoo · 2015-03-27T08:49:28Z

Thanks for contribution. Let me test this code.

- Added maven-shade-plugin - Removed copy-dependencies

- Fixed errors while running

- Removed unused codes

- Fixed 2 spaces indentations

- Reverted to initial commit

- Updated README.md

jongyoul · 2015-03-30T04:39:34Z

I've rebased this because README.md was changed.

Leemoonsoo · 2015-03-30T06:54:05Z

Tested and looks good to me 👍

1) Rest apis to export notebook as JSON 2) Rest api to import notebook from JSON https://issues.apache.org/jira/browse/ZEPPELIN-590 Author: swakrish <[email protected]> Author: Ramaswamy Devarajan <[email protected]> Closes #614 from swakrish/master and squashes the following commits: 83e7a6d [swakrish] Merge pull request #7 from apache/master 042d9af [swakrish] Merge pull request #6 from apache/master f5b0805 [swakrish] Merge branch 'master' of [email protected]:swakrish/incubator-zeppelin.git 869b48f [swakrish] logging the error f8bf1f3 [swakrish] Merge pull request #5 from apache/master f8a992c [swakrish] Merge branch 'master' of [email protected]:swakrish/incubator-zeppelin.git 270e17b [swakrish] changed soureJSON to sourceJson 4cb69be [swakrish] Merge pull request #4 from apache/master e282958 [swakrish] Changed websocket import to use common code e928c14 [swakrish] changed doc to make it http post 4be62f6 [swakrish] Merge branch 'master' of [email protected]:swakrish/incubator-zeppelin.git db6a580 [swakrish] changed HTTP Put to POST in the docs ec14034 [swakrish] Merge pull request #3 from apache/master 630664c [swakrish] Merge pull request #2 from apache/master b080d7d [swakrish] Merge pull request #1 from apache/master db8b016 [Ramaswamy Devarajan] added note not found check for export 7351f31 [Ramaswamy Devarajan] Moved export/import methods to Notebook.java 6c19668 [Ramaswamy Devarajan] Changed http put to Http post for REST import ecb8f1e [Ramaswamy Devarajan] Formatting for google style 9b64a66 [Ramaswamy Devarajan] fixed alignments 0e94dce [Ramaswamy Devarajan] add documentation 3645354 [Ramaswamy Devarajan] Rest Apis to export/import

### What is this PR for? This is a small refactoring to keep this Controller following the [ControllerAs with vm](https://github.com/johnpapa/angular-styleguide/tree/master/a1#controlleras-with-vm) rules, that it was based on. Here is a list of things that were changed and why: * Most of the controller's $scope values & fct (except from the search q) where moved to the vm.The controller is using vm, so storing in $scope to share with the view is not needed. * Functions or Vars that are not used in the view were removed from the vm. (kept private to the controller) * $rootscope functions was moved to `app.js`. I think the need for that function might need to be changed, but for the scope of this PR, we are just moving it to where the $rootScope values are declared. * Gathering vm declaration before the functions and ordered alphabetically * Re-order functions alphabetically * Create `initController ` to regroup all the controller setup. ### What type of PR is it? Refactoring ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1290 ### How should this be tested? You can Just verify that the below Navbar related features are still good: * Search Form * Connected Status * Login button * User Name and its dropdown menu * Notebook list drop-down menu (and filer, folder inside of it) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Author: CORNEAU Damien <[email protected]> Author: Prabhjyot Singh <[email protected]> Closes #1281 from corneadoug/Refactor/navbarCtrl and squashes the following commits: 31f9110 [CORNEAU Damien] Merge pull request #4 from prabhjyotsingh/logoutUserFix 4686a18 [Prabhjyot Singh] CI failure for testGroupPermission 2fde749 [Damien CORNEAU] finish cleaning the controller be18547 [Damien CORNEAU] Remove functions from navbar controller

### What is this PR for? Adding extra libraries to livy interpreter which isn't exist by default. ### What type of PR is it? [ Improvement ] ### Todos * [Test case ] - Task ### What is the Jira issue? * [ZEPPELIN-1258] ### How should this be tested? - Create new livy interpreter or modify the default. - Set `livy.spark.jars.packages` to list of maven coordinates of jars. The format for the coordinates should be groupId:artifactId:version. ### Screenshots (if appropriate) ![](https://s31.postimg.org/px78l7ql7/Screenshot_from_2016_08_03_16_59_00.png) ![](https://s32.postimg.org/96ucb5rb9/Screenshot_from_2016_08_03_17_00_30.png) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: mahmoudelgamal <[email protected]> Author: mfelgamal <[email protected]> Author: Fouad <[email protected]> Closes #1255 from mfelgamal/feature/modifying-livy-doc and squashes the following commits: 5411a2f [mahmoudelgamal] changeing default to example d7f6818 [mahmoudelgamal] Adding livy.spark.jars.packages property 98090ab [mahmoudelgamal] Adding external libraries to livy 03a1e80 [mfelgamal] Merge pull request #4 from apache/master 2586651 [Fouad] Merge pull request #2 from apache/master

## What is this PR for? The PR is a interpreter for [Apache Beam](http://beam.incubator.apache.org) which is an open source unified platform for data processing pipelines. A pipeline can be build using one of the Beam SDKs. The execution of the pipeline is done by different Runners . Currently, Beam supports Apache Flink Runner, Apache Spark Runner, and Google Dataflow Runner. ### What type of PR is it? - Feature ### Todos * Test case * Review Comments * Documentation ### What is the Jira issue? * [ZEPPELIN-682] ### How should this be tested? - Start the Zeppelin server - The prefix of interpreter is `%beam` and then write your code with required imports and the runner ### Screenshots (if appropriate) ![](https://s9.postimg.org/s6eiwrbxb/beam_interpreter.png) ![](https://s9.postimg.org/eq3h8wsrz/visualisation_with_table.png) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: mahmoudelgamal <[email protected]> Author: mfelgamal <[email protected]> Author: Fouad <[email protected]> Closes #1334 from mfelgamal/beam-interpreter-static-repl-7 and squashes the following commits: da66c27 [mahmoudelgamal] Modify condition of checking static modifier 55c1322 [mahmoudelgamal] set spark version to 1.6.2 and throw original exception 27d7690 [mahmoudelgamal] set spark version to 1.6.1 and some modifications 750041c [mahmoudelgamal] Add readme file and modify pom file and travis.yml ca88f94 [mahmoudelgamal] edit pom file and .travis.yml 3d65427 [mahmoudelgamal] update .travis.yml file f19f98d [mahmoudelgamal] Make easy example with imports ands some modifications 74c14ca [mahmoudelgamal] Update the licenses acc7afb [mahmoudelgamal] Change beam to version 0.2.0 e821614 [mahmoudelgamal] Removing hadoop-core and print stack trace to failure 5cb7c7b [mahmoudelgamal] Add some changes to doc and pom file 75fc4f7 [mahmoudelgamal] add interpreter to navigation.html and remove extra spaces and lines 9b1b385 [mahmoudelgamal] put beam in alphabetical order 9c1e25d [mahmoudelgamal] Adding changes like logging and conventions and license 2aa6d65 [mahmoudelgamal] changing class name to StaticRepl and adding some modifications 7cf25fb [mahmoudelgamal] Adding some tests 3c5038f [mahmoudelgamal] Modifying the documentation 5695077 [mahmoudelgamal] Modifying pom file and Making documentation 26fc59b [mahmoudelgamal] Refactoring of the code 3a2bd85 [mahmoudelgamal] Adding the beam to zeppelin 7 ab7ee2d [mahmoudelgamal] beam interpreter 85957ff [mfelgamal] Merge pull request #10 from apache/master 852c3d3 [mfelgamal] Merge pull request #9 from apache/master a4bcc0d [mfelgamal] Merge pull request #8 from apache/master 858f1e1 [mfelgamal] Merge pull request #7 from apache/master 03a1e80 [mfelgamal] Merge pull request #4 from apache/master 2586651 [Fouad] Merge pull request #2 from apache/master

### What is this PR for? This Good Practice Guide promotes the usage of `ng-bind` instead of the classic `{{}}` syntax, to have a performance boost. ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1495 ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <[email protected]> Closes #1463 from corneadoug/ZEPPELIN-1495 and squashes the following commits: 102b62b [Damien CORNEAU] Add small update to Guide #1 23e64dc [Damien CORNEAU] Fix escaping of angular {{}} c420d8a [Damien CORNEAU] Add Good Practice #4

## What is this PR for? The PR is a interpreter for [Apache Beam](http://beam.incubator.apache.org) which is an open source unified platform for data processing pipelines. A pipeline can be build using one of the Beam SDKs. The execution of the pipeline is done by different Runners . Currently, Beam supports Apache Flink Runner, Apache Spark Runner, and Google Dataflow Runner. ### What type of PR is it? - Feature ### Todos * Test case * Review Comments * Documentation ### What is the Jira issue? * [ZEPPELIN-682] ### How should this be tested? - Start the Zeppelin server - The prefix of interpreter is `%beam` and then write your code with required imports and the runner ### Screenshots (if appropriate) ![](https://s9.postimg.org/s6eiwrbxb/beam_interpreter.png) ![](https://s9.postimg.org/eq3h8wsrz/visualisation_with_table.png) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes Author: mahmoudelgamal <[email protected]> Author: mfelgamal <[email protected]> Author: Fouad <[email protected]> Closes apache#1334 from mfelgamal/beam-interpreter-static-repl-7 and squashes the following commits: da66c27 [mahmoudelgamal] Modify condition of checking static modifier 55c1322 [mahmoudelgamal] set spark version to 1.6.2 and throw original exception 27d7690 [mahmoudelgamal] set spark version to 1.6.1 and some modifications 750041c [mahmoudelgamal] Add readme file and modify pom file and travis.yml ca88f94 [mahmoudelgamal] edit pom file and .travis.yml 3d65427 [mahmoudelgamal] update .travis.yml file f19f98d [mahmoudelgamal] Make easy example with imports ands some modifications 74c14ca [mahmoudelgamal] Update the licenses acc7afb [mahmoudelgamal] Change beam to version 0.2.0 e821614 [mahmoudelgamal] Removing hadoop-core and print stack trace to failure 5cb7c7b [mahmoudelgamal] Add some changes to doc and pom file 75fc4f7 [mahmoudelgamal] add interpreter to navigation.html and remove extra spaces and lines 9b1b385 [mahmoudelgamal] put beam in alphabetical order 9c1e25d [mahmoudelgamal] Adding changes like logging and conventions and license 2aa6d65 [mahmoudelgamal] changing class name to StaticRepl and adding some modifications 7cf25fb [mahmoudelgamal] Adding some tests 3c5038f [mahmoudelgamal] Modifying the documentation 5695077 [mahmoudelgamal] Modifying pom file and Making documentation 26fc59b [mahmoudelgamal] Refactoring of the code 3a2bd85 [mahmoudelgamal] Adding the beam to zeppelin 7 ab7ee2d [mahmoudelgamal] beam interpreter 85957ff [mfelgamal] Merge pull request apache#10 from apache/master 852c3d3 [mfelgamal] Merge pull request apache#9 from apache/master a4bcc0d [mfelgamal] Merge pull request apache#8 from apache/master 858f1e1 [mfelgamal] Merge pull request apache#7 from apache/master 03a1e80 [mfelgamal] Merge pull request apache#4 from apache/master 2586651 [Fouad] Merge pull request apache#2 from apache/master

And redo for CI (apache#4)

[ZP-9] Add support for variables in JDBCInterpreter statementPrecode.

…Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ### What is this PR for? - fix the [CI failure](https://travis-ci.org/github/apache/zeppelin/builds/709913046) due to [PR-3852](#3852) ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * [ZEPPELIN-4962](https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4962) ### How should this be tested? * CI test ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: xie-jia-jun <[email protected]> Author: JakeXie <[email protected]> Closes #3860 from xiejiajun/ZEPPELIN-4962 and squashes the following commits: 9128c9b [JakeXie] spark.repl.target docs update ad4c0e3 [xiejiajun] Clear irrelevant code a12d3a9 [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ab2b191 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 5569788 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 0a9af6c [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master be36b37 [xiejiajun] 合并Apache Master分支冲突解决 1335d55 [xiejiajun] Merge remote-tracking branch 'origin/master' fc59f57 [JakeXie] Merge pull request #4 from apache/master 9cc70fe [xiejiajun] Merge remote-tracking branch 'origin/master' 6ef9b23 [xie-jia-jun] Merge pull request #3 from apache/master 45af87a [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly f149c3b [xie-jia-jun] Merge pull request #1 from apache/master 5d4b645 [xie-jia-jun] Support OSSConfigStorage of Aliyun dbb6639 [xie-jia-jun] Add Aliyun OSS SDK bb47849 [xie-jia-jun] Support S3ConfigStorage of AWS

…Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ### What is this PR for? - fix the [CI failure](https://travis-ci.org/github/apache/zeppelin/builds/709913046) due to [PR-3852](#3852) ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * [ZEPPELIN-4962](https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4962) ### How should this be tested? * CI test ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: xie-jia-jun <[email protected]> Author: JakeXie <[email protected]> Closes #3860 from xiejiajun/ZEPPELIN-4962 and squashes the following commits: 9128c9b [JakeXie] spark.repl.target docs update ad4c0e3 [xiejiajun] Clear irrelevant code a12d3a9 [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL and fix the CI failure due to low Scala version ab2b191 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 5569788 [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master 0a9af6c [xiejiajun] Merge branch 'master' of https://github.com/apache/zeppelin into apache-master be36b37 [xiejiajun] 合并Apache Master分支冲突解决 1335d55 [xiejiajun] Merge remote-tracking branch 'origin/master' fc59f57 [JakeXie] Merge pull request #4 from apache/master 9cc70fe [xiejiajun] Merge remote-tracking branch 'origin/master' 6ef9b23 [xie-jia-jun] Merge pull request #3 from apache/master 45af87a [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly f149c3b [xie-jia-jun] Merge pull request #1 from apache/master 5d4b645 [xie-jia-jun] Support OSSConfigStorage of Aliyun dbb6639 [xie-jia-jun] Add Aliyun OSS SDK bb47849 [xie-jia-jun] Support S3ConfigStorage of AWS (cherry picked from commit 185ffd4) Signed-off-by: Jeff Zhang <[email protected]>

jongyoul force-pushed the ZEPPELIN-7 branch from 887628c to ac8936e Compare March 27, 2015 02:32

jongyoul added 6 commits March 30, 2015 13:37

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR

32be4ca

- Added maven-shade-plugin - Removed copy-dependencies

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR

91066c4

- Fixed errors while running

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR

29ea46b

- Removed unused codes

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR

b366d16

- Fixed 2 spaces indentations

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR

7f84a5a

- Reverted to initial commit

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR

df697c1

- Updated README.md

jongyoul force-pushed the ZEPPELIN-7 branch from 36dcac6 to df697c1 Compare March 30, 2015 04:37

asfgit closed this in 58fd82b Mar 30, 2015

alourie mentioned this pull request Jul 13, 2017

0.7.1 with ssl #2238

Closed

prabhjyotsingh mentioned this pull request Oct 13, 2017

[Minor] Remove hardcoded key in zeppelinhub. #2621

Closed

gef756 added a commit to gef756/zeppelin that referenced this pull request Oct 16, 2017

MRG: Merge remote-tracking branch 'upstream/master' into dev-login-enter

842c253

And redo for CI (apache#4)

Leemoonsoo mentioned this pull request Nov 28, 2017

[ZEPPELIN-3076]Chart field is also draggable and sortable in the 'keys', 'groups' and 'values' #2686

Closed

Savalek pushed a commit to Savalek/zeppelin that referenced this pull request Jan 21, 2019

Merge pull request apache#4 from TinkoffCreditSystems/BI-6300

e595f3e

[ZP-9] Add support for variables in JDBCInterpreter statementPrecode.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR #4

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR #4

Uh oh!

jongyoul commented Mar 26, 2015

Uh oh!

jongyoul commented Mar 26, 2015

Uh oh!

jongyoul commented Mar 27, 2015

Uh oh!

Leemoonsoo commented Mar 27, 2015

Uh oh!

jongyoul commented Mar 30, 2015

Uh oh!

Leemoonsoo commented Mar 30, 2015

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR #4

[ZEPPELIN-7] Support yarn without SPARK_YARN_JAR #4

Uh oh!

Conversation

jongyoul commented Mar 26, 2015

Uh oh!

jongyoul commented Mar 26, 2015

Uh oh!

jongyoul commented Mar 27, 2015

Uh oh!

Leemoonsoo commented Mar 27, 2015

Uh oh!

jongyoul commented Mar 30, 2015

Uh oh!

Leemoonsoo commented Mar 30, 2015

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants