merge latest master updates#1
Merged
mfelgamal merged 111 commits intomfelgamal:masterfrom Sep 7, 2016
Merged
Conversation
### What is this PR for? Casting data types in Pandas DataFrame to string in z.show() ### What type of PR is it? Bug Fix ### What is the Jira issue? [ZEPPELIN-1255](https://issues.apache.org/jira/browse/ZEPPELIN-1255) ### How should this be tested? ``` %python import pandas as pd df = pd.read_csv('https://archive.ics.uci.edu/ml/machine-learning-databases/iris/iris.data', header=None) df.columns=[1, 2, 3, 'PetalWidth', 'Name'] z.show(df) %python.sql SELECT * FROM df LIMIT 10 ``` ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: paulbustios <pbustios@gmail.com> Closes #1249 from bustios/ZEPPELIN-1255 and squashes the following commits: 82c1412 [paulbustios] Add test case for z.show() Pandas DataFrame 4a8c0a9 [paulbustios] [ZEPPELIN-1255] Add cast to string in z.show() for Pandas DataFrame
…terpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA ### What is this PR for? Fix CI test failure with error ``` 14:05:27,226 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,227 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:264 - Failed to initialize interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA. Remove it from interpreterGroup 14:05:27,240 INFO org.apache.zeppelin.scheduler.SchedulerFactory:131 - Job jobName1 started by scheduler test 14:05:27,240 INFO org.apache.zeppelin.interpreter.remote.RemoteInterpreter:223 - Create remote interpreter org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,242 ERROR org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA 14:05:27,243 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed org.apache.zeppelin.interpreter.InterpreterException: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:238) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:299) at org.apache.zeppelin.scheduler.RemoteSchedulerTest$2.jobRun(RemoteSchedulerTest.java:210) at org.apache.zeppelin.scheduler.Job.run(Job.java:176) at org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: org.apache.thrift.TApplicationException: Internal error processing createInterpreter at org.apache.thrift.TApplicationException.read(TApplicationException.java:111) at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:196) at org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:180) at org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:227) ... 12 more ``` Some unittest launches remote interpreter process for the test with some mock interpreter implementation. So mock interpreter class in the test should be available for interpreter's classpath for the test. ### What type of PR is it? Hot Fix ### Todos * [x] - Add necessary test-classes directory in interpreter process's classpath ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1264 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1261 from Leemoonsoo/ZEPPELIN-1264 and squashes the following commits: 10ad928 [Lee moon soo] Add zeppelin-interpreter/target/test-classes, zeppelin-zengine/target/test-classes in classpath of interpreter
### What is this PR for? This PR fixes R interpreter doesn't work with Spark 2.0 ### What type of PR is it? Bug Fix ### Todos * [x] - Create and inject SparkSession into SparkRInterpreter ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1260 ### How should this be tested? Run Zeppelin with Spark 2.0 and run following codes and see if it returns `[1] 3` ``` %r localDF <- data.frame(name=c("a", "b", "c"), age=c(19, 23, 18)) df <- createDataFrame(spark, localDF) count(df) ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1259 from Leemoonsoo/ZEPPELIN-1260 and squashes the following commits: b3df11f [Lee moon soo] inject sqlContext as well 02822ac [Lee moon soo] Change indent 6bd1128 [Lee moon soo] Create and inject spark session into sparkr interpreter
### What is this PR for? straightforward doc fix ### What type of PR is it? [Documentation] ### Todos * [ ] - Task ### What is the Jira issue? * No jira created as it is very trival. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1268 from zjffdu/r_doc_fix and squashes the following commits: 105fead [Jeff Zhang] minor doc fix for r.md
### What is this PR for? Bug fix in z.show() for matplotlib graphs and code refactoring ### What type of PR is it? Bug Fix ### What is the Jira issue? [ZEPPELIN-1261](https://issues.apache.org/jira/browse/ZEPPELIN-1261) ### How should this be tested? ``` %python import matplotlib.pyplot as plt x = [1,2,3,4,5] y = [6,7,8,9,0] plt.plot(x, y, marker="o") z.show(plt, height="20em") plt.close() ``` ``` %python import matplotlib.pyplot as plt x = [1,2,3,4,5] y = [6,7,8,9,0] plt.plot(x, y, marker="o") z.show(plt, height="300px") plt.close() ``` ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Paul Bustios <pbustios@gmail.com> Closes #1267 from bustios/ZEPPELIN-1261 and squashes the following commits: 82c631a [Paul Bustios] Add 100% as a default value for width and height z.show() parameters 3e0ef22 [Paul Bustios] Bug fix in show_matplotlib
…ter in docs ### What is this PR for? As new interpreter registration mechanism which was started in [ZEPPELIN-804](https://issues.apache.org/jira/browse/ZEPPELIN-804), we can't set default interpreter anymore using `zeppelin-site.xml` as described in [https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration) (see `zeppelin.interpreters` property description in the configuration table). So we need to remove the related contents in Zeppelin docs site. Below pages will be updated: - [https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration) - [https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelininterpreter.html#060-and-later](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelininterpreter.html#060-and-later) ### What type of PR is it? Documentation ### What is the Jira issue? [ZEPPELIN-1209](https://issues.apache.org/jira/browse/ZEPPELIN-1209) ### How should this be tested? No need to test. Just removed two sentences about the default interpreter setting. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1207 from AhyoungRyu/ZEPPELIN-1209 and squashes the following commits: 61108f4 [AhyoungRyu] Add a sentence about the deprecation 9f44f22 [AhyoungRyu] Remove useless sentence about default interpreter in docs
…roduction environments. ### What is this PR for? This PR is for documentation for running zeppelin on production environments. ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1198 ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <hsshim@nflabs.com> Closes #1227 from astroshim/ZEPPELIN-1198/standalone and squashes the following commits: 53a32f2 [astroshim] add 'via Docker' 61a0e5e [astroshim] add apache license header 83fdef6 [astroshim] doc for spark standalone
… print in pyspark interpreter ### What is this PR for? For now, user need to invoke print to make the output displayed on the notebook. This behavior is not natural and consistent with other notebooks. This PR is to make the pyspark interpreter in zeppelin behave the same as other notebook. 2 main changes * use single mode to compile the last statement, so that the evaluation result of the last statement will be printed to stdout, this is consistent with other notebooks (like jupyter) * Make SparkOutputStream extends LogOutputStream so that we can see the output of inner process (Python/R), it is helpful for diagnosing. ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1197 ### How should this be tested? Tested it manually. Input the following text in pyspark paragraph, ``` 1+1 sc.version ``` And get the following output ``` u'1.6.1' ``` ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? User don't need to call print explicitly. * Does this needs documentation? Yes Author: Jeff Zhang <zjffdu@apache.org> Closes #1232 from zjffdu/ZEPPELIN-1197 and squashes the following commits: 3771245 [Jeff Zhang] fix and add test 10182e6 [Jeff Zhang] ZEPPELIN-1197. Should print output directly without invoking function print in pyspark interpreter
### What is this PR for? This is to fix logger source class name for correct logs. ### What type of PR is it? Bug Fix ### Todos * [x] - change class name ### What is the Jira issue? n/a ### How should this be tested? passing CI ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Khalid Huseynov <khalidhnv@gmail.com> Closes #1226 from khalidhuseynov/fix/logging-classname and squashes the following commits: 1fad00f [Khalid Huseynov] change class name
### What is this PR for? Add a new Shiro Realm that lets users authenticate in Apache Zeppelin using their ZeppelinHub credentials. ### What type of PR is it? `Feature` ### Todos * [x] - Create ZeppelinHub Realm that extends `AuthorizingRealm`. * [x] - Update `shiro.ini` file and add ZeppelinHub configuration template. * [x] - Add documentation ### What is the Jira issue? [Issue 1164](https://issues.apache.org/jira/browse/ZEPPELIN-1164) ### How should this be tested? - Assuming that you already have an account [Zeppelinhub](https://www.zeppelinhub.com/register), edit `conf/shiro.ini` file and uncomment ZeppelinHub related configuration. - Start your Zeppelin - Login with your ZeppelinHub credentials. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? YES Author: Anthony Corbacho <corbacho.anthony@gmail.com> Closes #1173 from anthonycorbacho/feat/ZeppelinHubAuthentication and squashes the following commits: 63b06c6 [Anthony Corbacho] Fix rebase mistake in documentation 0f16344 [Anthony Corbacho] Fix typo in documentation 5a27871 [Anthony Corbacho] Add Documentation about ZeppelinHub Realm configuration 8347fa9 [Anthony Corbacho] Handle long line > 100 char 9bf96ba [Anthony Corbacho] Remove author tag... 64154d4 [Anthony Corbacho] Add more method comments. c207b5e [Anthony Corbacho] Change check of token.getUsername() in doGetAuthenticationInfo by using StringUtils::isBlank instead of checking only null. 38683e1 [Anthony Corbacho] Add new setting in Shiri.ini to handle ZeppelinHub realm. 34a8e5e [Anthony Corbacho] Create new Apache Shiro Realm for ZeppelinHub
### What is this PR for? Fixing the bug that users cannot delete some interpreter settings from interpreter tab. ### What type of PR is it? [Bug Fix | Hot Fix] ### Todos * [x] - Changed `update` to `set` ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1240 ### How should this be tested? 1. Make new interpreter via interpreter tab 1. remove some properties ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jongyoul Lee <jongyoul@gmail.com> Closes #1239 from jongyoul/ZEPPELIN-1240 and squashes the following commits: 4cd5854 [Jongyoul Lee] Enabled to remove some properties 57cd328 [Jongyoul Lee] Changed updateProperties to setProperties
…oles as well ### What is this PR for? Auto-suggestion of notebook permissions should list roles as well ### What type of PR is it? [Improvement] ### Todos * [x] - Fix test case (selenium) * [x] - select2 in bower.json ### What is the Jira issue? * [ZEPPELIN-1237](https://issues.apache.org/jira/browse/ZEPPELIN-1237) ### How should this be tested? Search for group/roles in notebook permission, it should get listed ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? n/a * Is there breaking changes for older versions? n/a * Does this needs documentation? n/a Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #1236 from prabhjyotsingh/ZEPPELIN-1237 and squashes the following commits: b944dc2 [Prabhjyot Singh] Merge remote-tracking branch 'origin/master' into ZEPPELIN-1237 17e17a9 [Prabhjyot Singh] implement @r-kamath feedback 0793c10 [Prabhjyot Singh] Auto-suggestion of notebook permissions should list group as well
### What is this PR for? PySparkInterpreter doesn't work in spark 2.0 because pyspark and py4j is not distributed to executors. This PR extract the setup staff for pyspark interpreter into method setupConfForPySpark and use it for both spark1 and spark2. But this is just a short term solution, as I think this should be handled by spark rather than zeppelin, here zeppelin duplicate part of spark's work. In the long term, I'd like to resolve it in `ZEPPELIN-1263`. ### What type of PR is it? [Bug Fix] ### Todos * https://issues.apache.org/jira/browse/ZEPPELIN-1263 ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1267 ### How should this be tested? Verify it manually. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1260 from zjffdu/ZEPPELIN-1267 and squashes the following commits: 81d1d56 [Jeff Zhang] ZEPPELIN-1267. PySparkInterpreter doesn't work in spark 2.0
### What is this PR for? Small cleanup of zeppelin-server tests ### What type of PR is it? Refactoring ### How should this be tested? ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alexander Bezzubov <bzz@apache.org> Closes #1263 from bzz/cleanup/zeppelin-server-tests and squashes the following commits: 0dd89ca [Alexander Bezzubov] Small cleanup of org.apache.zeppelin.* tests
### What is this PR for? Small refactoring of Python interpreter, that is what it is. ### What type of PR is it? Refactoring ### Todos * [x] refactor `help()` * [x] impl `maxResult` fetch from JVM ### How should this be tested? `cd python && mvn -Dpython.test.exclude='' test ` pass (given that `pip install pandasql` and `pip install py4j`) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Alexander Bezzubov <bzz@apache.org> Closes #1275 from bzz/python/refactoring and squashes the following commits: 15a35c8 [Alexander Bezzubov] Make .help() method a single string literal e800fd7 [Alexander Bezzubov] Make Python fetch maxResults from JVM
### What is this PR for? If the result of many para- graph, the code editor is very slow. ### What type of PR is it? Improvement ### Todos - [x] removed call to function in template. - [x] changed event (aceChange event to ace input event) ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1266 ### How should this be tested? 1. going to r tutorial notebook. 2. write to paragraph on anyway. (many many.. fast.. fast typing.) ### Screenshots (if appropriate) #### Before optimization.  #### After optimization.  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <cloverheartsdev@gmail.com> Closes #1258 from cloverhearts/dev/aceeditorperformance and squashes the following commits: 2bde378 [CloverHearts] removed local variable setParagarphmode to global variable for code editor optimization. 9e2c7fc [CloverHearts] restore to aceChanged function for code editor optimization 86ba5c4 [CloverHearts] ace editor performance up
### What is this PR for? The Notebook Title Input would not disappear after being edited. This is a problem made by its plugin elastic-input. We originally used ng-if instead of ng-show so it doesn't break the Page Print, however that change made the scope value to toggle unusable. So we added a trustworthy small controller on top of the component. ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1276 ### How should this be tested? * Click on the Notebook title * Try to do: Enter or Esc or Click somewhere else * The Input border should not be there anymore * Do the same for the Paragraph * If you do Print Page there shouldn't any titles duplicated at the top ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Damien CORNEAU <corneadoug@gmail.com> Closes #1273 from corneadoug/ZEPPELIN-1276 and squashes the following commits: 7d32090 [Damien CORNEAU] Remove a test that check the showEditor in NotebookCtrl 24df51f [Damien CORNEAU] Fix eslint errors d590d82 [Damien CORNEAU] apply same input changes to the paragraph b862081 [Damien CORNEAU] Fix Notebook input issue
…Scala 2.11 ### What is this PR for? - build distribution package with Spark 2.0 and Scala 2.11 - change travis profile to use spark 2.0 instead of 2.0.0-preview by removing `-Dspark.version=2.0.0-preview` property - Change profile activation rule * current way of profile activation is not proper for supporting more than three scala version * -Pscala-2.11 activates both scala-2.10 and scala-2.11 profile without this patch ### What type of PR is it? Build ### What is the Jira issue? [ZEPPELIN-1256](https://issues.apache.org/jira/browse/ZEPPELIN-1256) ### How should this be tested? **Before** Run `mvn help:active-profiles -Pscala-2.11`: ``` Active Profiles for Project 'org.apache.zeppelin:zeppelin:pom:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-interpreter:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-zengine:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-display_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin-display_2.11:0.7.0-SNAPSHOT) - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark-dependencies_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - spark-2.0 (source: org.apache.zeppelin:zeppelin-spark-dependencies_2.11:0.7.0-SNAPSHOT) - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - exclude-sparkr (source: org.apache.zeppelin:zeppelin-spark_2.11:0.7.0-SNAPSHOT) - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-markdown:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-angular:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-shell:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-livy:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-hbase:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-postgresql:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-jdbc:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-file:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-flink_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-ignite_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-kylin:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-python:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-lens:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-cassandra_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-elasticsearch:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-alluxio:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-web:war:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-server:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin-server:0.7.0-SNAPSHOT) - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-distribution:pom:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin-distribution:0.7.0-SNAPSHOT) - scala-2.10 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) ``` **After** Run `mvn help:active-profiles -Dscala-2.11`: ``` Active Profiles for Project 'org.apache.zeppelin:zeppelin:pom:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-interpreter:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-zengine:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-display_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin-display_2.11:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark-dependencies_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - spark-2.0 (source: org.apache.zeppelin:zeppelin-spark-dependencies_2.11:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-spark_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - exclude-sparkr (source: org.apache.zeppelin:zeppelin-spark_2.11:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-markdown:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-angular:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-shell:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-livy:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-hbase:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-postgresql:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-jdbc:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-file:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-flink_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-ignite_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-kylin:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-python:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-lens:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-cassandra_2.11:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-elasticsearch:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-alluxio:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-web:war:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-server:jar:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin-server:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) Active Profiles for Project 'org.apache.zeppelin:zeppelin-distribution:pom:0.7.0-SNAPSHOT': The following profiles are active: - scala-2.11 (source: org.apache.zeppelin:zeppelin-distribution:0.7.0-SNAPSHOT) - scala-2.11 (source: org.apache.zeppelin:zeppelin:0.7.0-SNAPSHOT) ``` ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? yes (for scala 2.11 build) Author: Mina Lee <minalee@apache.org> Closes #1251 from minahlee/ZEPPELIN-1256 and squashes the following commits: ff034c6 [Mina Lee] change scala-2.10 and scala-2.11 profile activation rule 99d91bf [Mina Lee] Update interpreter installation for the user who use Spark version <= 1.6.2 4ca3e7f [Mina Lee] Build distribution package with Spark 2.0 and Scala 2.11
…to solve CI problem ### What is this PR for? ### What type of PR is it? Hot Fix ### Todos * [x] - Copy spark profiles from spark-dependencies/pom.xml to spark/pom.xml ### What is the Jira issue? ### How should this be tested? ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1292 from Leemoonsoo/spark_profile and squashes the following commits: 5ca88b4 [Lee moon soo] handle sparkr profile with spark* profiles e5cb5df [Lee moon soo] copy spark related profiles from spark-dependencies/pom.xml to spark/pom.xml
### What is this PR for? zeppelin custom key binding event optimization for Ace Code editor ### What type of PR is it? Improvement ### Todos - [x] optimization for key binding and check logic ### How should this be tested? For many in the code editor and typing quickly. The effect is greater when there are many Paragraph. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <cloverheartsdev@gmail.com> Closes #1287 from cloverhearts/dev/codeditorKeyBindOptimization and squashes the following commits: 76cd284 [CloverHearts] paragraph move jum bug fixed. 27f7146 [CloverHearts] Modify the style syntax for code editor e4c37b1 [CloverHearts] move to original key bind function for codeeditor optimiza 6a9edbe [CloverHearts] change access type $scope access member to local variable and add last row check logic 8cc63b7 [CloverHearts] fixed syntax error for editor key binding optimization. b37788d [CloverHearts] Code editor key binding event optimization.
### What is this PR for? optimize to Paragraph move logic The problem is slowness of movement for the paragraph - paragraph. I've optimized it. ### What type of PR is it? Improvement ### Jira issue https://issues.apache.org/jira/browse/ZEPPELIN-1296 ### Todos * [x] - when pargaraph move then pass to digest loop. ### How should this be tested? 1. create to many paragarph. 2. first or last row in pargarph. 3. on keypress to 'up' and down. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <cloverheartsdev@gmail.com> Closes #1289 from cloverhearts/dev/paragraphMoveUpDownPerformanceUp and squashes the following commits: 8379a53 [CloverHearts] remove white space between function () 7ec8e98 [CloverHearts] optimize to Paragraph move logic
### What is this PR for? #1292 fixed CI problem. However, build command fails with -Pyarn ``` [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-yarn-api:jar must be a valid version but is '${yarn.version}'. line 939, column 20 [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique but found duplicate declaration of plugin org.apache.maven.plugins:maven-dependency-plugin line 341, column 15 [ERROR] The build could not read 1 project -> [Help 1] [ERROR] [ERROR] The project org.apache.zeppelin:zeppelin-spark_2.10:0.7.0-SNAPSHOT (/Users/moon/Projects/zeppelin/spark/pom.xml) has 1 error [ERROR] 'dependencies.dependency.version' for org.apache.hadoop:hadoop-yarn-api:jar must be a valid version but is '${yarn.version}'. line 939, column 20 [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ProjectBuildingException ``` ### What type of PR is it? Hot Fix ### Todos * [x] - set yarn.version property when -Pyarn is activated ### How should this be tested? Build zeppelin with -Pyarn activated Author: Lee moon soo <moon@apache.org> Closes #1298 from Leemoonsoo/move_profile_followup and squashes the following commits: e3bc780 [Lee moon soo] set yarn.version property
…er menu. ### What is this PR for? This PR fixes a bug of showing checkbox for "Connect to existing process" on interpreter menu. ### What type of PR is it? Bug Fix ### How should this be tested? Go to interpreter menu and check if checkbox for "Connect to existing process" exists. ### Screenshots (if appropriate) - before  - after  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <hsshim@nflabs.com> Closes #1229 from astroshim/bugfix/showCheckbox and squashes the following commits: 4b3673a [astroshim] add css to interpreter-create page 17fb0d7 [astroshim] change size to px 47ce719 [astroshim] remove height style on the checkbox bbc3283 [astroshim] show checkbox on interpreter menu.
…roperty ### What is this PR for? As of Spark 1.5.0, the default value of 'spark.executor.memory' is 1g, not 512m so let's follow the change. ### What type of PR is it? Improvement ### Todos * [x] - Replaced all of the occurrences of the default value of spark.executor.memory with '1g' ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1289 ### How should this be tested? Should be checked by some people's eyes. ### Questions: * Does the licenses files need update?: no * Is there breaking changes for older versions?: no * Does this needs documentation?: no Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp> Closes #1280 from sarutak/ZEPPELIN-1289 and squashes the following commits: bd58d8f [Kousuke Saruta] Modified the default value of "spark.executor.memory"
### What is this PR for? Now that the logo of Spark is updated so it's better to use it in the document. ### What type of PR is it? Improvement ### Todos * [x] - Replace the old Spark logo with the new one ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1288 ### How should this be tested? Check by some people. ### Questions: * Does the licenses files need update?: no * Is there breaking changes for older versions?: no * Does this needs documentation?: no Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp> Closes #1279 from sarutak/ZEPPELIN-1288 and squashes the following commits: d1b8d73 [Kousuke Saruta] Updated the logo of Spark
### What is this PR for?
SparkSession.wrapped is only for spark 2.0 preview, it is not supported in spark 2.0 release. So I think we can remove that piece of code. Otherwise we will get the following error in log which might be a little confusing.
```
08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) - org.apache.spark.sql.SparkSession.wrapped()
java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped()
at java.lang.Class.getMethod(Class.java:1786)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
```
### What type of PR is it?
[Improvement]
### Todos
* [ ] - Task
### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1270
### How should this be tested?
Check the log and the above error is gone.
### Screenshots (if appropriate)
### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No
Author: Jeff Zhang <zjffdu@apache.org>
Closes #1269 from zjffdu/ZEPPELIN-1270 and squashes the following commits:
a685e66 [Jeff Zhang] ZEPPELIN-1270. Remove getting SQLContext from SparkSession.wrapped()
### What is this PR for? SparkInterpreter misses code completion for scala 2.11 This PR make code completion works with spark 2.0 and scala 2.11 ### What type of PR is it? Improvement ### Todos * [x] - Implement code completion for scala 2.11 * [x] - add unittest ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1300 ### How should this be tested? Unittest included. Try `ctrl + .` in your %spark paragraph ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Lee moon soo <moon@apache.org> Closes #1291 from Leemoonsoo/ZEPPELIN-1300 and squashes the following commits: 7edc209 [Lee moon soo] Support scala 2.11.7 as well as 2.11.8 27c572b [Lee moon soo] add log message when completer not found 909b44b [Lee moon soo] find class silently 9ecbe70 [Lee moon soo] Add create completer based on class existance 0fefc6d [Lee moon soo] Implement SparkInterpreter.completion for scala 2.11
### What is this PR for? Some of the doc files say "SparkSQL" but the collect spelling is "Spark SQL" (need a white space between "Spark" and "SQL"). Lets's replace it with the collect one. ### What type of PR is it? Improvement ### Todos * [x] - Replace all of "SparkSQL" in some files into "Spark SQL". ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1274 ### How should this be tested? Check the changes by some people. Author: Kousuke Saruta <sarutak@oss.nttdata.co.jp> Closes #1271 from sarutak/ZEPPELIN-1274 and squashes the following commits: edc9212 [Kousuke Saruta] Further replaced "SparkSQL" and "SparkSql" into "Spark SQL" 14aa2b7 [Kousuke Saruta] Replaced 'SparkSQL' in docs into 'Spark SQL'
…be called for y axis values ### What is this PR for? Use Math.abs to determine if custom formatter should be called for y axis values. ### What type of PR is it? Bug Fix ### Todos * [ ] - Task ### What is the Jira issue? [ZEPPELIN-1273] https://issues.apache.org/jira/browse/ZEPPELIN-1273 ### How should this be tested? Create simple table with two columns - date in one and large negative numbers like -10000000 in other. Display line chart and see that the y axis values are formatted like -10M. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Prasad Wagle <pwagle@twitter.com> Closes #1270 from prasadwagle/ZEPPELIN-1273 and squashes the following commits: 2c62f56 [Prasad Wagle] Merge branch 'master' into ZEPPELIN-1273 06e12f8 [Prasad Wagle] Use Math.abs to determine if custom formatter should be called for y axis values
### What is this PR for? This PR uses websocket to get and save interpreter bindings instead of rest api ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1254 ### How should this be tested? Go to interpreter binding settings on notebook page and enable/disable interpreter or reorder and save. Simultaneously verify the network calls on browser's console. ### Screenshots (if appropriate) n/a ### Questions: * Does the licenses files need update? n/a * Is there breaking changes for older versions? n/a * Does this needs documentation? n/a Author: Renjith Kamath <renjith.kamath@gmail.com> Closes #1247 from r-kamath/ZEPPELIN-1254 and squashes the following commits: 6ac1748 [Renjith Kamath] ZEPPELIN-1254 revert indentation 55d95ec [Renjith Kamath] ZEPPELIN-1254 review fix ab0bced [Renjith Kamath] ZEPPELIN-1254 boradcast after updating the interpreter bindings 299bb51 [Renjith Kamath] ZEPPELIN-1254 review fix 97bfd7d [Renjith Kamath] ZEPPELIN-1254 Make get and save Interpreter bindings calls via websocket
….getSystemDefault and update relative code ### What is this PR for? clean some redundant code: remove `SparkInterpreter.getSystemDefault` methods, and replace it with `InterpreterProperty.getValue` ### What type of PR is it? Improvement ### Todos N/A ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1383 remove SparkInterpreter.getSystemDefault and update relative code ### How should this be tested? Existing tests. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: WeichenXu <WeichenXu123@outlook.com> Closes #1372 from WeichenXu123/remove_spark_interpreter_getSystemDefault and squashes the following commits: 204a34c [WeichenXu] improve code stype. 841b757 [WeichenXu] update.
### What is this PR for? Making spark/pom.xml simple ### What type of PR is it? [Refactoring] ### Todos * [x] - Simplified pom.xml in spark ### What is the Jira issue? N/A ### How should this be tested? No test. CI should be green ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jongyoul Lee <jongyoul@gmail.com> Closes #1301 from jongyoul/minor/remove-unused-profile-spark-pom and squashes the following commits: 10c7bb7 [Jongyoul Lee] Removed yarn dependency b6d8876 [Jongyoul Lee] Removed yarn dependency 77ddd95 [Jongyoul Lee] Removed unused profiles from spark/pom.xml
… gitignore ### What is this PR for? When compile and test zeppelin-Rinterpreter, it will generate temp directories `/R` and `/tmp` add them into `.gitignore` ### What type of PR is it? Improvement ### Todos N/A ### What is the Jira issue? N/A ### How should this be tested? N/A ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: WeichenXu <WeichenXu123@outlook.com> Closes #1297 from WeichenXu123/gitignore_add_R_tmp and squashes the following commits: 478a0dc [WeichenXu] gitignore add R tmp dir
### What is this PR for? As per existing usage, the time shown in end of each paragraph is the time the paragraph is updated not when the paragraph is actually executed/run. _" Took 10 sec. Last updated by anonymous at **August 26 2016, 1:52:01 PM.** "_ PR is aimed at changing the existing usage to show when the paragraph is last executed as this gives clarification to users about the executed time of paragraph ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1040 ### How should this be tested? 1. Start the server and create a new note book 2. create a new paragraph and execute the paragraph 3. Now rerun the paragraph, the time should get updated now inline with execution of the paragraph ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: rajarajan-g <rajarajan.ganesan@imaginea.com> Closes #1367 from rajarajan-g/ZEPPELIN-1040 and squashes the following commits: d30f1b2 [rajarajan-g] code changed for showing last run time after execution of paragraph
### What is this PR for? This fixes when the input json is empty for the clone notebook REST API and for this case the default name will be populated. ### What type of PR is it? Bug Fix ### Todos NA ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1313 ### How should this be tested? When the input json is empty for the clone notebook REST API, the response should be 201 with the default name populated. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Kavin <kavin.kumar@imaginea.com> Author: Kavin Kumar <junokavin@gmail.com> Closes #1348 from kavinkumarks/zeppelin-1313-fix-NPE-clone-notebook and squashes the following commits: 941e13b [Kavin] Removed note.id() and replaced the references with note.getId() 11a2903 [Kavin Kumar] Fixed NPE when the input json is empty for clone notebook REST API and set the default name for the case.Added test cases too.
### What is this PR for? Don't use ZEPPELIN_JAVA_OPTS as the default value of ZEPPELIN_INTP_JAVA_OPTS ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1185 ### How should this be tested? Tested manually. By exporting the following variable, I can debug zeppelin server correctly and remote interpreter process can ran successfully. (Before this PR, the remote interpreter process will fail to launch because it would also listen the same debug port) ``` export ZEPPELIN_JAVA_OPTS="-agentlib:jdwp=transport=dt_socket,server=y,suspend=y,address=5005" ``` Author: Jeff Zhang <zjffdu@apache.org> Closes #1189 from zjffdu/ZEPPELIN-1185 and squashes the following commits: 9e48ad7 [Jeff Zhang] change for windows 3ff5561 [Jeff Zhang] update doc format e82d889 [Jeff Zhang] add migration doc ef5a360 [Jeff Zhang] ZEPPELIN-1185. ZEPPELIN_INTP_JAVA_OPTS should not use ZEPPELIN_JAVA_OPTS as default value
### What is this PR for? This PR will fix [ZEPPELIN-1217](https://issues.apache.org/jira/browse/ZEPPELIN-1217). Current [Zeppelin configuration table](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration) is hard to compare the env variable name with the descriptions at a glance because of the horizontal scrollbar. So I just removed the scrollbar. ### What type of PR is it? Improvement ### What is the Jira issue? [ZEPPELIN-1217](https://issues.apache.org/jira/browse/ZEPPELIN-1217) ### Screenshots (if appropriate) - Before  - After  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: AhyoungRyu <fbdkdud93@hanmail.net> Closes #1241 from AhyoungRyu/ZEPPELIN-1217 and squashes the following commits: eb96fc4 [AhyoungRyu] Remove horizontal scrollbar in Zeppelin conf table
### What is this PR for? fix some spelling mistakes just like this: zepplin -> zeppelin ### What type of PR is it? [Documentation] ### Todos * [ ] - Task ### What is the Jira issue? * No jira created ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Liu Xiang <lxmtlab@gmail.com> Closes #1386 from sloth2012/master and squashes the following commits: fdb4e51 [Liu Xiang] fix some word spell errors
### What is this PR for? Right now, when calling the REST API `http://<ip>:<port>/api/notebook/job/<note_id>/<paragraph_id>` Zeppelin always returns **OK** as shown by this source code: https://github.com/apache/incubator-zeppelin/blob/master/zeppelin-server/src/main/java/org/apache/zeppelin/rest/NotebookRestApi.java#L477 This ticket will update the behavior so that Zeppelin also return the result of the paragraph execution ### What type of PR is it? [Improvement] ### Todos * [ ] - Code Review * [ ] - Simple Test ### Is there a relevant Jira issue? **[ZEPPELIN-699]** ### How should this be tested? * `git fetch origin pull/746/head:ParagraphExecutionRESTAPI` * `git checkout ParagraphExecutionRESTAPI` * `mvn clean package -DskipTests` * `bin/zeppelin-daemon.sh restart` * Create a new note * In the first paragraph, put the following code ```scala %sh echo "Current time = "`date +"%T" ``` * Retrieve the current note id in the URL * Retrieve the current paragraph id * Use a REST Client like **[POSTman]** to create a HTTP POST query `http://<ip>:<port>/api/notebook/run/<note_id>/<paragraph_id>` * You should receive something similar as follow for answer ``` { "status": "OK", "body": { "code": "SUCCESS", "type": "TEXT", "msg": "Current time = 16:14:18\n" } } ``` ### Screenshots (if appropriate)  API Documentation update **Existing asynchronous API**  **New synchronous API**  ### Questions: * Does the licenses files need update? --> **No** * Is there breaking changes for older versions? --> **No** * Does this needs documentation? --> **Yes** [ZEPPELIN-699]: https://issues.apache.org/jira/browse/ZEPPELIN-699 [POSTman]: https://www.getpostman.com/ Author: DuyHai DOAN <doanduyhai@gmail.com> Closes #746 from doanduyhai/ZEPPELIN-699 and squashes the following commits: fb0570c [DuyHai DOAN] [ZEPPELIN-699] Update Notebook REST API documentation 8367acf [DuyHai DOAN] [ZEPPELIN-699] Add new synchronous paragraph run REST API
### What is this PR for? On Flink interpreter, remove provided scope from scala libraries to enable copying them to interpreter location. ### What type of PR is it? [Bug Fix] ### What is the Jira issue? [ZEPPELIN-1379](https://issues.apache.org/jira/browse/ZEPPELIN-1379) Author: Luciano Resende <lresende@apache.org> Closes #1370 from lresende/flink-dependencies and squashes the following commits: 8e2ea20 [Luciano Resende] [ZEPPELIN-1379] Flink interpreter is missing scala libraries
… 2.11 broken ### What is this PR for? As described in ZEPPELIN-1384, we may hit the following error when running zeppelin on spark 1.6 if we build zeppelin this way ``` dev/change_scala_version.sh 2.11 mvn -DskipTests -Drat.skip=true -Pscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0 -Phadoop-2.6 -Pyarn -Ppyspark -Psparkr clean package ``` ``` java.lang.NoSuchMethodError: scala.runtime.VolatileByteRef.create(B)Lscala/runtime/VolatileByteRef; at scala.xml.MetaData$.iterate$1(MetaData.scala:39) at scala.xml.MetaData$.normalize(MetaData.scala:45) at scala.xml.Elem.<init>(Elem.scala:99) at org.apache.spark.ui.jobs.StagePage$$anonfun$26.apply(StagePage.scala:57) at org.apache.spark.ui.jobs.StagePage$$anonfun$26.apply(StagePage.scala:55) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244) at scala.collection.immutable.List.foreach(List.scala:318) at scala.collection.TraversableLike$class.map(TraversableLike.scala:244) at scala.collection.AbstractTraversable.map(Traversable.scala:105) at org.apache.spark.ui.jobs.StagePage.<init>(StagePage.scala:55) at org.apache.spark.ui.jobs.StagesTab.<init>(StagesTab.scala:34) at org.apache.spark.ui.SparkUI.<init>(SparkUI.scala:57) at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:195) at org.apache.spark.ui.SparkUI$.createLiveUI(SparkUI.scala:146) at org.apache.spark.SparkContext.<init>(SparkContext.scala:473) at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext_1(SparkInterpreter.java:440) at org.apache.zeppelin.spark.SparkInterpreter.createSparkContext(SparkInterpreter.java:354) at org.apache.zeppelin.spark.SparkInterpreter.getSparkContext(SparkInterpreter.java:137) at org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:743) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69) at org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93) ``` The root cause is that scala-xml is removed from scala 2.11 to a separate library, so here we have class conflict of scala-xml api. In this PR, I make the scope of scala-xml to be provided and also make the scope of scala-library to be provided although it will be override in `ZEPPELIN_HOME/spark/pom.xml` ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1384 ### How should this be tested? Tested manually. Use the following command to build zeppelin and then run it on spark-1.6.2 ``` dev/change_scala_version.sh 2.11 mvn -DskipTests -Drat.skip=true -Pscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0 -Phadoop-2.6 -Pyarn -Ppyspark -Psparkr clean package ``` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1377 from zjffdu/ZEPPELIN-1384 and squashes the following commits: eb07535 [Jeff Zhang] ZEPPELIN-1384. Spark interpreter binary compatibility to scala 2.10 / 2.11 broken
### What is this PR for? This PR fixes the bug of running application in development mode. ### What type of PR is it? Bug Fix ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1365 ### How should this be tested? 1. run zeppelin 2. run org.apache.zeppelin.interpreter.dev.ZeppelinApplicationDevServer in development mode. (http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/development/writingzeppelinapplication.html) 3. and run paragraph like screenshot. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <hsshim@nflabs.com> Closes #1358 from astroshim/ZEPPELIN-1365 and squashes the following commits: 9f640e5 [astroshim] add argument check.
…rpreter with the same key but different settings ### What is this PR for? print error while existing registedInterpreter with the same key but different settings. In order to compare the property Map in the Interpreter easily, I override the `equals` method in `InterpreterProperty` class. (and `hashCode` at the same time) and I fix a small error in `InterpreterProperty.toString()`, its result forgot `}` in the end. ### What type of PR is it? Improvement ### Todos ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1391 ### How should this be tested? Existing tests. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: WeichenXu <WeichenXu123@outlook.com> Closes #1382 from WeichenXu123/interpreter_key_error_check and squashes the following commits: 4ef032e [WeichenXu] print error while existing registedInterpreter with the same key but different settings
### What is this PR for? Add new line before logging paragraph content ### What type of PR is it? [Improvement] Author: Luciano Resende <lresende@apache.org> Closes #1374 from lresende/debug and squashes the following commits: 0f6e80c [Luciano Resende] [MINOR] Add new line before logging paragraph content
… failure on npm install ### What is this PR for? Recently CI build fails a lot on npm install on building zeppelin-web module with network issues. This PR tries to cache zeppelin-web/node_modules on travis and see it it helps reducing network issues. ### What type of PR is it? Improvement ### Todos * [x] - Cache zeppelin-web/node_modules Author: Lee moon soo <moon@apache.org> Closes #1285 from Leemoonsoo/cache_node_modules and squashes the following commits: 3995f44 [Lee moon soo] trigger ci 1e2116d [Lee moon soo] trigger ci 48c175f [Lee moon soo] update cache before after_success or after_failure 5d32766 [Lee moon soo] trigger ci aa45ed6 [Lee moon soo] echo c027207 [Lee moon soo] cache zeppelin-web/node_modules on travis ci
### What is this PR for? Removing old JDBC sugar ### What type of PR is it? [Feature] ### Todos * [x] - Removed codes to check jdbc alias enabled ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1366 ### How should this be tested? * No longer available * `%jdbc(mysql)` -> `%mysql` ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? Yes * Does this needs documentation? Yes, but I don't know where the proper location is. Author: Jongyoul Lee <jongyoul@gmail.com> Closes #1360 from jongyoul/ZEPPELIN-1366 and squashes the following commits: f9df86e [Jongyoul Lee] Changed description 302825c [Jongyoul Lee] Removed effectiveText and related test 929bad2 [Jongyoul Lee] Updated docs for breaking changes e52521f [Jongyoul Lee] Removed test for jdbc sugar 9f46bbd [Jongyoul Lee] Resolved codes conflicted
…available ### What is this PR for? Use absolute path for ssl truststore and keystore when available ### What type of PR is it? Improvement ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1319 ### How should this be tested? Config `zeppelin.ssl.truststore.path`, `zeppelin.ssl.keystore.path` and verify whether the absolute path or the path relative to conf is used. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? n/a * Is there breaking changes for older versions? n/a * Does this needs documentation? n/a Author: Renjith Kamath <renjith.kamath@gmail.com> Closes #1319 from r-kamath/ZEPPELIN-1319 and squashes the following commits: 5587d5a [Renjith Kamath] ZEPPELIN-1319 add check for Windows path fc2ac9f [Renjith Kamath] ZEPPELIN-1319 Use absolute path for ssl truststore and keystore when available
…rpreter name ### What is this PR for? Ignore implicit interpreter when user enter wrong interpreter name linked to #806 (comment) This PR is related to #1113 ZEPPELIN-1069 branch was force push, so couldn't reopen that PR. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1069 ### How should this be tested? Unit test Run-time checking ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: Minwoo Kang <minwoo.kang@outlook.com> Closes #1248 from mwkang/ZEPPELIN-1069 and squashes the following commits: 3976a96 [Minwoo Kang] Remove wild card import fa7a194 [Minwoo Kang] Fix CI failed f0eedeb [Minwoo Kang] Remove unnecessary method. 6e91dfe [Minwoo Kang] Remove unnecessary method. dd60d72 [Minwoo Kang] Fixed CI 046f5f4 [Minwoo Kang] Modify static import position. 6082e28 [Minwoo Kang] Modify that StringUtils is static import 02a1c2a [Minwoo Kang] Refactor method name 4912c5c [Minwoo Kang] Add test cases b6520be [Minwoo Kang] Add function that is replName is binding.
### What is this PR for? dot is invalid for interpreter name as it is used as the separator of interpreter group name and interpreter name. ### What type of PR is it? [Improvement] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1374 ### How should this be tested? Tested it manually as shown in the screenshot. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1365 from zjffdu/ZEPPELIN-1374 and squashes the following commits: d36d437 [Jeff Zhang] add rest api checking 0620c6a [Jeff Zhang] ZEPPELIN-1374. Should prevent use dot in interpreter name
### What is this PR for? This PR is for the documentation of running zeppelin on production environments especially spark on mesos via Docker. Related issue is #1227 and #1318 and I got a lot of hints from https://github.com/sequenceiq/hadoop-docker. Tested on ubuntu. ### What type of PR is it? Documentation ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1279 ### How should this be tested? You can refer to https://github.com/apache/zeppelin/blob/master/docs/README.md#build-documentation. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: astroshim <hsshim@nflabs.com> Author: AhyoungRyu <fbdkdud93@hanmail.net> Author: HyungSung <hsshim@nflabs.com> Closes #1389 from astroshim/ZEPPELIN-1279 and squashes the following commits: 974366a [HyungSung] Merge pull request #10 from AhyoungRyu/ZEPPELIN-1279-ahyoung 076fdba [AhyoungRyu] Change zeppelin_mesos_conf.png file 1cbe9d3 [astroshim] fix spark version and mesos 2b821b4 [astroshim] fix docs 159bafc [astroshim] fix anchor d8c43b4 [astroshim] add navigation c808350 [astroshim] add image file and doc a3b0ded [astroshim] create dockerfile for mesos
### What is this PR for? There are 2 issues and their proposed fixes: 1. On a paragraph run, for every line of output, there is a broadcast of the new line from zeppelin. In case of thousands of lines of output, the browser/s would hang because of the volume of these append-output events. 2. In the above case, besides the browser-hang, another bug observed is that result data is will repeated twice (coming from append-output calls + finish-event calls). The proposed solution for #1 is: - Buffer the append-output event into a queue instead of sending the event immediately. - In a separate thread, read from the queue periodically and send the append-output event. Solution for #2 is: - Donot append output to result if the paragraph is not runnig. ### What type of PR is it? Improvement + Bug Fix ### Todos ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1292 ### How should this be tested? The test could be to run a simple paragraph with large result. Eg: ``` %sh for i in {1..10000} do echo $i done ``` PS: One will need to clear browser cache between running with and without this code patch since there are javascript changes as well. ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? It could need for the design. Otherwise I have added code comments explaining behaviour. Author: Beria <beria@qubole.com> Closes #1283 from beriaanirudh/ZEPPELIN-1292 and squashes the following commits: 17f0524 [Beria] Use diamond operator 7852368 [Beria] nit 4b68c86 [Beria] fix checkstyle d168614 [Beria] Remove un-necessary class CheckAppendOutputRunner 2eae38e [Beria] Make AppendOutputRunner non-static 72c316d [Beria] Scheduler service to replace while loop in AppendOutputRunner 599281f [Beria] fix unit tests that run after dd24816 [Beria] Add license in test file 3984ef8 [Beria] fix tests when ran with other tests 1c893c0 [Beria] Add licensing 1bdd669 [Beria] fix javadoc comment 27790e4 [Beria] Avoid infinite loop in tests 5057bb3 [Beria] Incorporate feedback 1. Synchronize on AppendOutputRunner creation 2. Use ScheduledExecutorService instead of while loop 3. Remove Thread.sleep() from tests 82e9c4a [Beria] Fix comment 7020f0c [Beria] Buffer append output results + fix extra incorrect results
### What is this PR for? Rename "R" directory to "2BWJFTXKJ" under notebook directory to make it look like all other notebooks. ### What type of PR is it? [Refactoring] ### Todos * [x] - Rename ### What is the Jira issue? * N/A ### How should this be tested? goto $ZEPPELIN_HOME/notebook directory, under this there should be no "R" directory. On starting zeppelin-server, the existing notebook should be listed. ### Screenshots (if appropriate) N/A ### Questions: * Does the licenses files need update? N/A * Is there breaking changes for older versions? N/A * Does this needs documentation? N/A Author: Prabhjyot Singh <prabhjyotsingh@gmail.com> Closes #1394 from prabhjyotsingh/renameRDirectory and squashes the following commits: 5993506 [Prabhjyot Singh] rename r directory to 2BWJFTXKJ
…he numbers correctly ### What is this PR for? Automatically detect the data type for the contents in the table. This enables the sorting on numerical/date columns. Please see https://issues.apache.org/jira/browse/ZEPPELIN-1372 for details. ### What type of PR is it? [Bug Fix | Improvement] ### Todos * [ ] - Task ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1372 ### How should this be tested? Click on the title of columns and see whether the numeric contents are correctly sorted. ### Screenshots (if appropriate) #### For numbers Before  After  #### For dates Before  After  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Peilin Yang <peiliny@twitter.com> Closes #1371 from Peilin-Yang/ZEPPELIN-1372 and squashes the following commits: 72e470c [Peilin Yang] Merge branch 'master' into ZEPPELIN-1372 0333722 [Peilin Yang] refactor the logic ab9713d [Peilin Yang] add more constraints to the number c081f04 [Peilin Yang] switch the type detection of number/date to speed it up 461f00e [Peilin Yang] move the data type parsing at the same time when table data is loaded 7d62eb2 [Peilin Yang] automatic detect the type of the input in table for sorting purpose
### What is this PR for? This is for fixing bug introduced in #1365. I may introduce this when rebasing the PR. ### What type of PR is it? [Bug Fix] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1374] ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jeff Zhang <zjffdu@apache.org> Closes #1403 from zjffdu/HotFix_ZEPPELIN-1374 and squashes the following commits: 032bafa [Jeff Zhang] HotFix for ZEPPELIN-1374
### What is this PR for? Create a specific build for checking license compliance with RAT and avoid running these checks on every build that compose the PR build. As for normal development builds, this follows the same pattern used for maven tests, RAT is enabled to run by default, but now there is support disabling it with -DskipRat. Travis CI will run RAT once, on the RAT build, and disable RAT checks on all other build profiles. ### What type of PR is it? [Enhancement] ### What is the Jira issue? * [ZEPPELIN-1409](https://issues.apache.org/jira/browse/ZEPPELIN-1409) Author: Luciano Resende <lresende@apache.org> Closes #1401 from lresende/build and squashes the following commits: f755979 [Luciano Resende] [[ZEPPELIN-1409]] Add support for skipping RAT check with -DskipRat 0189991 [Luciano Resende] [ZEPPELIN-1409] Refactor RAT build on Travis.CI configuration
### What is this PR for? Use relative path for search_data.json ### What type of PR is it? [Bug Fix] ### What is the Jira issue? * [ZEPPELIN-1398](https://issues.apache.org/jira/browse/ZEPPELIN-1398) Author: AhyoungRyu <fbdkdud93@hanmail.net> Author: Luciano Resende <lresende@apache.org> Closes #1387 from lresende/search and squashes the following commits: 005f8dc [AhyoungRyu] [ZEPPELIN-1398] Fix wrong path in searched docs link f081b87 [AhyoungRyu] [ZEPPELIN-1398] Make screenshots.md not searchable 84b1b2b [Luciano Resende] [ZEPPELIN-1398] Use relative path for search_data.json
### What is this PR for? better jdbc error msg make people know the true error clearly. ### What type of PR is it? Improvement ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1116 ### How should this be tested? Outline the steps to test the PR here. ### Screenshots (if appropriate)  ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no in sql case, the real error exception stack is hide in e.getCause.getCause. use printStackTrace to receive all the stack trace make people know true reason. Author: passionke <kejiqing@gmail.com> Closes #1379 from passionke/passionke-jdbc-better-errortips and squashes the following commits: a1735ed [passionke] Update JDBCInterpreter.java 3d56183 [passionke] import java.io 0e2010d [passionke] send out more exception msg
### What is this PR for? Remove duplicated declaration of maven dependency ### What type of PR is it? [Bug Fix] Author: Luciano Resende <lresende@apache.org> Closes #1402 from lresende/maven-artifact-duplicated and squashes the following commits: cd18347 [Luciano Resende] [MINOR] Remove duplicated dependency declaration
…hon interpreter ### What is this PR for? currently, has not support multiline exception text on python interpreter. for example: ``` Exception: blabla ``` is error. but ``` Traceback (most recent call last): File "<stdin>", line 1, in <module> Exception: test exception ``` is sucess (now) to resolve this issue. ### What type of PR is it? Bug Fix ### Todos - [x] modification pythonErrorIn method - [x] add test case ### What is the Jira issue? https://issues.apache.org/jira/browse/ZEPPELIN-1412?jql=project%20%3D%20ZEPPELIN%20AND%20status%20%3D%20Open ### How should this be tested? added test case. ### Questions: * Does the licenses files need update? no * Is there breaking changes for older versions? no * Does this needs documentation? no Author: CloverHearts <cloverheartsdev@gmail.com> Closes #1407 from cloverhearts/dev/ZEPPELIN-1412 and squashes the following commits: e674134 [CloverHearts] add multiline support pythonErrorIn method
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What is this PR for?
A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - https://github.com/apache/zeppelin/blob/master/CONTRIBUTING.md
What type of PR is it?
[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]
Todos
What is the Jira issue?
How should this be tested?
Outline the steps to test the PR here.
Screenshots (if appropriate)
Questions: