Skip to content

Conversation

@minahlee
Copy link
Member

@minahlee minahlee commented Oct 1, 2015

This PR enables Zeppelin to reflect addition/changes/removal of {ZEPPELIN_NOTEBOOK_DIR}/{notebookId}/note.json on the file system without restarting ZeppelinServer.

To activate this functionality, user needs to set ZEPPELIN_NOTEBOOK_GET_FROM_REPO to be true in conf/zeppelin-env.sh.

@Leemoonsoo
Copy link
Member

Nice improvement. Could you choose little more intuitive name than ZEPPELIN_NOTEBOOK_GET_FROM_REPO ?

@minahlee
Copy link
Member Author

minahlee commented Oct 5, 2015

@Leemoonsoo @khalidhuseynov ready for review

@anthonycorbacho
Copy link
Contributor

why do you need to activate this functionality? shouldnt be a expected behavior?

@minahlee
Copy link
Member Author

minahlee commented Oct 5, 2015

Beacause this PR will load notebooks from storage everytime client requests notebook list, which can be burden to Zeppelin with a bunch of notebooks. So I wanted to make as less effect as possible on current behavior. Would it be better to activate it by default?

@anthonycorbacho
Copy link
Contributor

so why not using a watcher? like if someone drop a notebook in the notebook dir, you update the list of notebook.

@Leemoonsoo
Copy link
Member

I think activating this function by default will brings some IO overhead in some cases. (large number of big notebooks). As @minahlee mentioned, it's better to keep it de-activated by default. When the implementation becomes more efficient it can be activated by default. That could be future work.
So, Looks good to me.

@Leemoonsoo
Copy link
Member

Merging if there're no more discussions

@asfgit asfgit closed this in 4b8512b Oct 14, 2015
asfgit pushed a commit that referenced this pull request Nov 8, 2015
This PR resolves https://issues.apache.org/jira/browse/ZEPPELIN-367 by synchronizing with secondary storage when reloading all notebooks into memory. Currently, existing `ZEPPELIN_NOTEBOOK_RELOAD_FROM_STORAGE` from #331 is used as a flag since these functionalities are correlated, however it can be separated into distinct flag as well.

Author: Khalid Huseynov <[email protected]>

Closes #375 from khalidhuseynov/sync-on-list and squashes the following commits:

e2cf5d9 [Khalid Huseynov] minor fix
878a23e [Khalid Huseynov] initial working commit
@minahlee minahlee deleted the ZEPPELIN-329 branch August 8, 2016 02:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants