-
Notifications
You must be signed in to change notification settings - Fork 6
Refactor JS code of streaming #5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Refactor JS code of streaming #5
Conversation
|
Thanks @corneadoug. The reason i manipulate DOM was, i wasn't sure about the performance of 'refreshing' angular data binding, especially output becomes thousand of lines. |
|
The size of the data wouldn't matter. For the refresh, We are already having similar behavior with progress bar. In Angular, what counts for performance is: Nb of watchers (values with data binding, here its only one), and the time of the digest loop (time to go through all the watchers). In this case we are good. On the other hand, accessing DOM is know to be an expensive task. This is a good read: https://www.airpair.com/angularjs/posts/angularjs-performance-large-applications |
|
Okay i got that. Then, will there be any performance implication in web browser? since updating data binding make browser re-render that area. |
|
I think it should be fine, there would be higher priority elsewhere to improve performances. Thats something we will have to work on while refactoring in the future. |
|
@corneadoug without DOM manipulate, it struggles printing large number of lines. |
|
Its slightly better, especially on scroll. However in both you can't do anything else and the page pretty much freeze |
|
On my machine with/without dom manipulatuon have some meaningfull differences. One not freeze the browser but the other freeze. |
|
Okay, then thats fine for now |
1) Rest apis to export notebook as JSON 2) Rest api to import notebook from JSON https://issues.apache.org/jira/browse/ZEPPELIN-590 Author: swakrish <[email protected]> Author: Ramaswamy Devarajan <[email protected]> Closes apache#614 from swakrish/master and squashes the following commits: 83e7a6d [swakrish] Merge pull request #7 from apache/master 042d9af [swakrish] Merge pull request #6 from apache/master f5b0805 [swakrish] Merge branch 'master' of [email protected]:swakrish/incubator-zeppelin.git 869b48f [swakrish] logging the error f8bf1f3 [swakrish] Merge pull request #5 from apache/master f8a992c [swakrish] Merge branch 'master' of [email protected]:swakrish/incubator-zeppelin.git 270e17b [swakrish] changed soureJSON to sourceJson 4cb69be [swakrish] Merge pull request #4 from apache/master e282958 [swakrish] Changed websocket import to use common code e928c14 [swakrish] changed doc to make it http post 4be62f6 [swakrish] Merge branch 'master' of [email protected]:swakrish/incubator-zeppelin.git db6a580 [swakrish] changed HTTP Put to POST in the docs ec14034 [swakrish] Merge pull request #3 from apache/master 630664c [swakrish] Merge pull request #2 from apache/master b080d7d [swakrish] Merge pull request #1 from apache/master db8b016 [Ramaswamy Devarajan] added note not found check for export 7351f31 [Ramaswamy Devarajan] Moved export/import methods to Notebook.java 6c19668 [Ramaswamy Devarajan] Changed http put to Http post for REST import ecb8f1e [Ramaswamy Devarajan] Formatting for google style 9b64a66 [Ramaswamy Devarajan] fixed alignments 0e94dce [Ramaswamy Devarajan] add documentation 3645354 [Ramaswamy Devarajan] Rest Apis to export/import
### What is this PR for? Enabling "Personalized Mode" for specific note ### What type of PR is it? [Feature] ### Todos * [x] - Backend work for supporting that feature * [x] - Develop front-end UI ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-1594 ### How should this be tested? 1. config.personalizedMode = true in note.json 1. Navigate some jobs in two different browser ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? No * Is there breaking changes for older versions? No * Does this needs documentation? No Author: Jongyoul Lee <[email protected]> Author: CloverHearts <[email protected]> Author: CloverHearts <[email protected]> Closes apache#1753 from jongyoul/ZEPPELIN-1594 and squashes the following commits: a9d8f7e [CloverHearts] change mode name shared to collaboration and dialog message (#5) 70f68d8 [Jongyoul Lee] Fixed dynamic forms Fixed NPE while broadcasting userParagraphsMap 2c7bd39 [CloverHearts] broadcast bugfix f59d26a [CloverHearts] implement update personalized mode websocket event in backend 9fcb7f8 [CloverHearts] implement ui 20425e7 [CloverHearts] add toggleNotePersonalizedMode and ui 4fabd88 [Jongyoul Lee] Fixed style a7c91f1 [Jongyoul Lee] Fixed the bug while not using personalized mode f627278 [Jongyoul Lee] Supported personalized mode
…Interpreter database connection pool ### What is this PR for? - Added support for personalized configuration of the JDBCInterpreter database connection pool. - This feature can be used to solve the runtime error caused by HiveServer2 Session timeout. - This connection pool configuration Compatible with [the official configuration of dbcp2 ](http://commons.apache.org/proper/commons-dbcp/configuration.html) ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/browse/ZEPPELIN-4941 ### How should this be tested? * manually tested * Supported configuration items - validationQuery - testOnBorrow - testOnCreate - testOnReturn - testWhileIdle - timeBetweenEvictionRunsMillis - maxWaitMillis - maxIdle - minIdle - maxTotal ### Screenshots (if appropriate) ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? NO Author: xiejiajun <[email protected]> Author: JakeXie <[email protected]> Author: xie-jia-jun <[email protected]> Closes apache#3844 from xiejiajun/jdbc-pool-config and squashes the following commits: 3bb622b [xiejiajun] use html table display datasource pool configuration in the jdbc.md document 88b1ce0 [xiejiajun] jdbc interpreter datasource connection pool document 1f2eb55 [xiejiajun] Compatible with the official configuration of dbcp2 connection pool 5c7f666 [xiejiajun] JDBCInterprete supports personalized database connection pool configuration to cope with scenarios such as HiveSession timeout 3d57719 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9 0e5f65a [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into apache-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly
…Spark Interpreter Scala REPL ### What is this PR for? - Support for manually specifying the Java version of Spark Interpreter Scala REPL. - This feature can be used to resolve runtime errors caused by reference to third-party libraries that use high-version Java in Spark Interpreter. ### What type of PR is it? [Feature] ### Todos * [ ] - Task ### What is the Jira issue? * https://issues.apache.org/jira/projects/ZEPPELIN/issues/ZEPPELIN-4950 ### How should this be tested? * manually tested * Specify spark.repl.target through %spark.conf or when configuring Spark Interpreter * Reference and call a Java method in a third-party library developed using Java 8 and using Java 8 features such as interface static methods through the Spark interpreter. If the call is successful, it means the test passed ### Screenshots (if appropriate) - A runtime error will be triggered when we reference a third-party library that uses the new features of Java8 if we using the default value `jvm-1.6` of `settings.target.value` :  ### Questions: * Does the licenses files need update? NO * Is there breaking changes for older versions? NO * Does this needs documentation? Yes Author: xiejiajun <[email protected]> Author: JakeXie <[email protected]> Author: xie-jia-jun <[email protected]> Closes apache#3852 from xiejiajun/spark_repl_target and squashes the following commits: d131f19 [xiejiajun] spark.md docs fix 6872054 [xiejiajun] add spark.repl.target to spark.md docs 6a05b4f [xiejiajun] Support for manually specifying the Java version of Spark Interpreter Scala REPL 6a2cf04 [xiejiajun] Merge branch 'branch-0.9' of https://github.com/apache/zeppelin into branch-0.9 076668a [JakeXie] Merge pull request #7 from apache/branch-0.9 00e14dd [JakeXie] Merge pull request #5 from apache/branch-0.9 9bb7341 [xiejiajun] Merge remote-tracking branch 'origin/branch-0.9' into branch-0.9 9bc5605 [xiejiajun] bug fix: when we removing a paragraph , an interpreter process refused to connect due to it abnormal stop , which eventually caused the remove paragraph operation to fail to complete. 97d2714 [xie-jia-jun] Merge pull request #2 from apache/branch-0.9 9b3c744 [xiejiajun] added timeout for getting Thrift client to avoid situations where the interpreter may not be restarted when the interpreter process exits unexpectedly (cherry picked from commit 054651f) Signed-off-by: Jeff Zhang <[email protected]>
There is no need to use DOM and JQuery here, angular data binding takes care of it