-
Notifications
You must be signed in to change notification settings - Fork 245
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Doc] update getting started guide based on latest databricks env [skip ci] #8221
[Doc] update getting started guide based on latest databricks env [skip ci] #8221
Conversation
Signed-off-by: liyuan <[email protected]>
Signed-off-by: liyuan <[email protected]>
 | ||
|
||
5. We will need to create an initialization script for the cluster that installs the RAPIDS jars to the | ||
cluster. Databricks recommends storing all cluster-scoped init scripts using workspace files. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit, indentation doesn't seem to match rest of file
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks, updated
Signed-off-by: liyuan <[email protected]>
|
||
 | ||
|
||
5. We will need to create an initialization script for the cluster that installs the RAPIDS jars to the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like we can delete the image file ../img/Databricks/initscript.png
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated, thanks
Navigate to your home directory in the UI and select **Create** > **File** from the menu, | ||
create an `init.sh` scripts with contents: | ||
```bash | ||
#!/bin/bash | ||
sudo wget -O /databricks/jars/rapids-4-spark_2.12-23.04.0.jar https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/23.04.0/rapids-4-spark_2.12-23.04.0.jar | ||
``` |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This makes the user interrupt their flow of Cluster creation. We are telling them to click away from the cluster config edit. Can we move it up as a preparation step?
Here we should only talk about specifying the init script created in the preparation step.
Add the init script path from Step X , e.g.,
/Users/user@domain/init.sh
, with the default destination typeWorkspace
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
move it to preparation step, thanks
Co-authored-by: Gera Shegalov <[email protected]>
Signed-off-by: liyuan <[email protected]>
Co-authored-by: Gera Shegalov <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
build |
…-2306 # Conflicts: # docs/demo/Databricks/generate-init-script.ipynb
Hi @gerashegalov , I merged remote to fix the conflicts, could you help review again? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
build |
This PR is to update getting started guide based on latest databricks env
Resolves #8209
Signed-off-by: liyuan [email protected]