Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/customizer/models/embedding.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ Create a Model Entity for this embedding model:

<Note>

Embedding models only support **merged LoRA** (`peft` with `merge=True`). Unmerged LoRA adapters are not supported because the embedding NIM requires ONNX format, which cannot represent standalone adapters.
Embedding models only support **merged LoRA** by setting `training.finetuning_type` to `"lora_merged"` in the Automodel job input. Unmerged LoRA adapters are not supported because the embedding NIM requires ONNX format, which cannot represent standalone adapters.

</Note>
### Resource Requirements
Expand Down
8 changes: 4 additions & 4 deletions docs/customizer/tutorials/embedding-customization-job.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -449,7 +449,7 @@
"\n",
"#### Quick Setup Example\n",
"\n",
"This tutorial fine-tunes [nvidia/llama-3.2-nv-embedqa-1b-v2](https://huggingface.co/nvidia/llama-3.2-nv-embedqa-1b-v2), NVIDIA embedding model optimized for question-answering and retrieval tasks."
"This tutorial fine-tunes [nvidia/llama-nemotron-embed-1b-v2](https://huggingface.co/nvidia/llama-nemotron-embed-1b-v2), an NVIDIA embedding model optimized for question-answering and retrieval tasks."
]
},
{
Expand Down Expand Up @@ -495,7 +495,7 @@
"source": [
"### 7. Create Base Model FileSet and Model Entity\n",
"\n",
"Create a fileset pointing to the [nvidia/llama-3.2-nv-embedqa-1b-v2](https://huggingface.co/nvidia/llama-3.2-nv-embedqa-1b-v2) embedding model from HuggingFace, then create a Model Entity that references this fileset. Model downloading will take place at training time."
"Create a fileset pointing to the [nvidia/llama-nemotron-embed-1b-v2](https://huggingface.co/nvidia/llama-nemotron-embed-1b-v2) embedding model from HuggingFace, then create a Model Entity that references this fileset. Model downloading will take place at training time."
]
},
{
Expand All @@ -513,7 +513,7 @@
" base_model_fs = client.files.filesets.create(\n",
" workspace=\"default\",\n",
" name=MODEL_NAME,\n",
" description=\"NVIDIA Llama 3.2 NV EmbedQA 1B v2 embedding model\",\n",
" description=\"NVIDIA Llama Nemotron Embed 1B v2 embedding model\",\n",
" storage=HuggingfaceStorageConfigParam(\n",
" type=\"huggingface\",\n",
" # repo_id is the full model name from Hugging Face\n",
Expand Down Expand Up @@ -986,4 +986,4 @@
},
"nbformat": 4,
"nbformat_minor": 2
}
}
6 changes: 3 additions & 3 deletions docs/customizer/tutorials/embedding-customization-job.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -368,7 +368,7 @@ Get your credentials:

#### Quick Setup Example

This tutorial fine-tunes [nvidia/llama-3.2-nv-embedqa-1b-v2](https://huggingface.co/nvidia/llama-3.2-nv-embedqa-1b-v2), NVIDIA embedding model optimized for question-answering and retrieval tasks.
This tutorial fine-tunes [nvidia/llama-nemotron-embed-1b-v2](https://huggingface.co/nvidia/llama-nemotron-embed-1b-v2), an NVIDIA embedding model optimized for question-answering and retrieval tasks.

```python
# Create secrets for model access
Expand Down Expand Up @@ -404,7 +404,7 @@ print(f"NGC_API_KEY secret: {NGC_SECRET_NAME}")

### 7. Create Base Model FileSet and Model Entity

Create a fileset pointing to the [nvidia/llama-3.2-nv-embedqa-1b-v2](https://huggingface.co/nvidia/llama-3.2-nv-embedqa-1b-v2) embedding model from HuggingFace, then create a Model Entity that references this fileset. Model downloading will take place at training time.
Create a fileset pointing to the [nvidia/llama-nemotron-embed-1b-v2](https://huggingface.co/nvidia/llama-nemotron-embed-1b-v2) embedding model from HuggingFace, then create a Model Entity that references this fileset. Model downloading will take place at training time.

```python
import time
Expand All @@ -418,7 +418,7 @@ try:
base_model_fs = client.files.filesets.create(
workspace="default",
name=MODEL_NAME,
description="NVIDIA Llama 3.2 NV EmbedQA 1B v2 embedding model",
description="NVIDIA Llama Nemotron Embed 1B v2 embedding model",
storage=HuggingfaceStorageConfigParam(
type="huggingface",
# repo_id is the full model name from Hugging Face
Expand Down
Loading
Loading