Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Doc] update getting started guide based on latest databricks env [skip ci] #8221

Merged
merged 8 commits into from
May 10, 2023

Conversation

nvliyuan
Copy link
Collaborator

@nvliyuan nvliyuan commented May 3, 2023

This PR is to update getting started guide based on latest databricks env

Resolves #8209

Signed-off-by: liyuan [email protected]

@nvliyuan nvliyuan requested a review from gerashegalov May 3, 2023 06:15
@nvliyuan nvliyuan self-assigned this May 3, 2023
@nvliyuan nvliyuan added the documentation Improvements or additions to documentation label May 3, 2023
![Init Script](../img/Databricks/initscript.png)

5. We will need to create an initialization script for the cluster that installs the RAPIDS jars to the
cluster. Databricks recommends storing all cluster-scoped init scripts using workspace files.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit, indentation doesn't seem to match rest of file

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks, updated

Signed-off-by: liyuan <[email protected]>

![Init Script](../img/Databricks/initscript.png)

5. We will need to create an initialization script for the cluster that installs the RAPIDS jars to the
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like we can delete the image file ../img/Databricks/initscript.png

Copy link
Collaborator Author

@nvliyuan nvliyuan May 8, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated, thanks

Comment on lines 74 to 79
Navigate to your home directory in the UI and select **Create** > **File** from the menu,
create an `init.sh` scripts with contents:
```bash
#!/bin/bash
sudo wget -O /databricks/jars/rapids-4-spark_2.12-23.04.0.jar https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark_2.12/23.04.0/rapids-4-spark_2.12-23.04.0.jar
```
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This makes the user interrupt their flow of Cluster creation. We are telling them to click away from the cluster config edit. Can we move it up as a preparation step?

Here we should only talk about specifying the init script created in the preparation step.

Add the init script path from Step X , e.g., /Users/user@domain/init.sh, with the default destination type Workspace.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

move it to preparation step, thanks

gerashegalov
gerashegalov previously approved these changes May 9, 2023
Copy link
Collaborator

@gerashegalov gerashegalov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gerashegalov
Copy link
Collaborator

build

@nvliyuan
Copy link
Collaborator Author

Hi @gerashegalov , I merged remote to fix the conflicts, could you help review again?

Copy link
Collaborator

@gerashegalov gerashegalov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gerashegalov
Copy link
Collaborator

build

@gerashegalov gerashegalov merged commit 3e48c17 into NVIDIA:branch-23.06 May 10, 2023
@nvliyuan nvliyuan deleted the databrick-doc-2306 branch May 6, 2024 09:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[DOC] Reference workspace in the databricks init script configuration doc
3 participants