Skip to content

Conversation

@xiejiajun
Copy link
Owner

What is this PR for?

A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - https://zeppelin.apache.org/contribution/contributions.html

What type of PR is it?

[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]

Todos

  • - Task

What is the Jira issue?

How should this be tested?

Screenshots (if appropriate)

Questions:

  • Does the licenses files need update?
  • Is there breaking changes for older versions?
  • Does this needs documentation?

zjffdu and others added 4 commits March 21, 2020 13:33
…0.180

### What is this PR for?

This PR is to fix the issue of use presto via jdbc interpreter. In this PR, I would only add properties that is valid for Presto jdbc driver. I tested it manully on the 2 versions of presto: prestodb, prestosql.

### What type of PR is it?
[Bug Fix ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2891

### How should this be tested?
* CI pass and manually tested on prestodb and prestosql.

### Screenshots (if appropriate)
![image](https://user-images.githubusercontent.com/164491/77071708-76f11000-6a27-11ea-812d-7396c0e1ebb9.png)

![image](https://user-images.githubusercontent.com/164491/77071717-7c4e5a80-6a27-11ea-825e-0b86174a30d5.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

Author: Jeff Zhang <zjffdu@apache.org>

Closes #3694 from zjffdu/ZEPPELIN-2891 and squashes the following commits:

2a77ae2 [Jeff Zhang] [ZEPPELIN-2891]. Impossible to use jdbc interface with presto-jdbc >= 0.180
…exited unexpectedly

### What is this PR for?
- added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly

### What type of PR is it?
- Bug Fix

### What is the Jira issue?
- https://issues.apache.org/jira/browse/ZEPPELIN-4691

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>

Closes #3695 from xiejiajun/branch-0.9 and squashes the following commits:

9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
@xiejiajun xiejiajun merged commit 97d2714 into xiejiajun:branch-0.9 Mar 23, 2020
xiejiajun added a commit that referenced this pull request May 26, 2020
…refused

### What is this PR for?
- an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete when i try remove a paragraph.

### What type of PR is it?
- Bug Fix

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4712

### Questions:
Does the licenses files need update? NO
Is there breaking changes for older versions? NO
Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3710 from xiejiajun/branch-0.9 and squashes the following commits:

9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly

(cherry picked from commit 3fdd8bb)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>
xiejiajun added a commit that referenced this pull request May 26, 2020
…refused

### What is this PR for?
- an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete when i try remove a paragraph.

### What type of PR is it?
- Bug Fix

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4712

### Questions:
Does the licenses files need update? NO
Is there breaking changes for older versions? NO
Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3710 from xiejiajun/branch-0.9 and squashes the following commits:

9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
xiejiajun added a commit that referenced this pull request Jul 13, 2020
…Interpreter database connection pool

### What is this PR for?
- Added support for personalized configuration of the JDBCInterpreter database connection pool.
- This feature can be used to solve the runtime error caused by HiveServer2 Session timeout.
- This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html)

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4941

### How should this be tested?
* manually tested
* Supported configuration items
    - validationQuery
    - testOnBorrow
    - testOnCreate
    - testOnReturn
    - testWhileIdle
    - timeBetweenEvictionRunsMillis
    - maxWaitMillis
    - maxIdle
    - minIdle
    - maxTotal

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3844 from xiejiajun/jdbc-pool-config and squashes the following commits:

3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document
88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool  document
1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool
5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout
3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
xiejiajun added a commit that referenced this pull request Jul 21, 2020
…Interpreter database connection pool

### What is this PR for?
- Added support for personalized configuration of the JDBCInterpreter database connection pool.
- This feature can be used to solve the runtime error caused by HiveServer2 Session timeout.
- This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html)

### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-4941

### How should this be tested?
* manually tested
* Supported configuration items
    - validationQuery
    - testOnBorrow
    - testOnCreate
    - testOnReturn
    - testWhileIdle
    - timeBetweenEvictionRunsMillis
    - maxWaitMillis
    - maxIdle
    - minIdle
    - maxTotal

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? NO

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3844 from xiejiajun/jdbc-pool-config and squashes the following commits:

3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document
88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool  document
1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool
5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout
3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
xiejiajun added a commit that referenced this pull request Jul 21, 2020
…Spark Interpreter Scala REPL

### What is this PR for?
- Support for manually specifying the Java version of Spark Interpreter Scala REPL.
- This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter.
 
### What type of PR is it?
[Feature]

### Todos
* [ ] - Task

### What is the Jira issue?
*  https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950

### How should this be tested?
* manually tested
    *  Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter
    *  Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed

### Screenshots (if appropriate)
- A runtime error will be triggered when  we reference a third-party library that uses the new features of Java8  if we using the default value `jvm-1.6`  of `settings.target.value` :
![image](https://user-images.githubusercontent.com/26395958/87297066-6581c580-c53a-11ea-989a-ad11001501f4.png)

### Questions:
* Does the licenses files need update? NO
* Is there breaking changes for older versions? NO
* Does this needs documentation? Yes

Author: xiejiajun <xiejiajun02@163.com>
Author: JakeXie <xiejiajun02@163.com>
Author: xie-jia-jun <xiejiajun02@163.com>

Closes apache#3852 from xiejiajun/spark_repl_target and squashes the following commits:

d131f19 [xiejiajun] spark.md docs fix
6872054 [xiejiajun] add spark.repl.target to spark.md docs
6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL  
6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9
076668a [JakeXie] Merge pull request #7 from apache/branch-0.9
00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9
9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9
9bc5605 [xiejiajun] bug fix:  when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete.
97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9
9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly

(cherry picked from commit 054651f)
Signed-off-by: Jeff Zhang <zjffdu@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants