Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/wheel-constraints/nemo-platform-services.txt
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ boto3==1.40.61
botocore==1.40.61
clickhouse-connect==0.15.1
cloudpickle==3.1.2
data-designer==0.8.0
data-designer==0.9.1
datasets==4.3.0
distro==1.9.0
docker==7.2.0
Expand All @@ -40,7 +40,7 @@ langchain-nvidia-ai-endpoints==1.4.3
langchain-openai==1.4.0
langchain==1.3.14
lark==1.3.1
nemo-anonymizer==0.3.1
nemo-anonymizer==0.3.3
nemo-fabric==0.1.1
nemo-relay==0.6.0
nemo-safe-synthesizer==0.1.7
Expand Down
6 changes: 3 additions & 3 deletions docs/data-designer/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ Data Designer on NeMo Platform enables high-quality synthetic data generation th

Data Designer is a framework for orchestrating complex synthetic data generation workflows. It coordinates LLM calls, manages dependencies between data fields, handles batching and parallelization, and validates generated data against specifications.

The plugin is built on the open-source [NVIDIA NeMo Data Designer library](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/getting-started/welcome) ([GitHub](https://github.com/NVIDIA-NeMo/DataDesigner)). The library provides the configuration and generation engine; the plugin provides CLI, SDK, Data Designer API, Jobs, Files API, Secrets API, and Inference Gateway API integration.
The plugin is built on the open-source [NVIDIA NeMo Data Designer library](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/getting-started/welcome) ([GitHub](https://github.com/NVIDIA-NeMo/DataDesigner)). The library provides the configuration and generation engine; the plugin provides CLI, SDK, Data Designer API, Jobs, Files API, Secrets API, and Inference Gateway API integration.

## How It Works

Expand Down Expand Up @@ -46,7 +46,7 @@ config_builder.add_column(dd.LLMTextColumnConfig(...))

Configuration code describes the dataset schema, columns, dependencies, constraints, seed data, processors, profilers, and inference settings.

**Learn more**: See the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/getting-started/welcome) for comprehensive guides on column types, samplers, constraints, and advanced features.
**Learn more**: See the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/getting-started/welcome) for comprehensive guides on column types, samplers, constraints, and advanced features.

### 2. Choose Where to Execute

Expand Down Expand Up @@ -99,7 +99,7 @@ Learn through examples: basics, seeding, and more.
Move configurations between local CLI and NeMo Services execution.

</Card>
<Card title="Library Documentation" href="https://docs.nvidia.com/nemo/datadesigner/v0.8.0/getting-started/welcome">
<Card title="Library Documentation" href="https://docs.nvidia.com/nemo/datadesigner/v0.9.1/getting-started/welcome">

Comprehensive guides on column types, constraints, and advanced features.

Expand Down
2 changes: 1 addition & 1 deletion docs/data-designer/migration.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -83,4 +83,4 @@ Before switching execution modes, verify:
- **Execution Modes:** See [Execution Modes](/documentation/design-synthetic-data/execution-modes) for the conceptual model.
- **CLI:** See [Data Designer CLI](/documentation/design-synthetic-data/cli) for `run`, `submit`, and persona commands.
- **Tutorials:** Follow the [tutorials](/documentation/design-synthetic-data/tutorials) for hands-on examples.
- **Library Docs:** Refer to the [open-source library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/getting-started/welcome) for configuration details.
- **Library Docs:** Refer to the [open-source library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/getting-started/welcome) for configuration details.
8 changes: 4 additions & 4 deletions docs/data-designer/tutorials/basics.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ description: ""

This tutorial demonstrates the fundamentals of Data Designer by generating a product review dataset.

For more detail about column behavior, see the [open-source library's version](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/tutorials/the-basics) of this tutorial.
For more detail about column behavior, see the [open-source library's version](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/tutorials/the-basics) of this tutorial.

## Prerequisites

Expand Down Expand Up @@ -47,7 +47,7 @@ config_builder = dd.DataDesignerConfigBuilder(model_configs)

### Add Columns

Define the columns for your dataset. The [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/tutorials/the-basics) explains these column types in detail.
Define the columns for your dataset. The [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/tutorials/the-basics) explains these column types in detail.


```python
Expand Down Expand Up @@ -305,5 +305,5 @@ When you use CLI `submit` or the SDK today:

- **Seed data:** Learn how to use external datasets in the [seeding tutorial](/documentation/design-synthetic-data/tutorials/seeding-with-external-datasets)
- **Execution modes:** Learn more about local and NeMo Services execution in [Execution Modes](/documentation/design-synthetic-data/execution-modes)
- **Column types:** Explore all available column types in the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/concepts/columns)
- **Advanced features:** Learn about [processors](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/concepts/processors) and [validation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/concepts/validators)
- **Column types:** Explore all available column types in the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/concepts/columns)
- **Advanced features:** Learn about [processors](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/concepts/processors) and [validation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/concepts/validators)
2 changes: 1 addition & 1 deletion docs/data-designer/tutorials/index.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ Data Designer separates **configuration** (building dataset schemas) from **exec

**Part 1: Build Configs (Library)**

Use `data_designer.config` to define your dataset. See the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/getting-started/welcome) for comprehensive guides on column types, constraints, and processors.
Use `data_designer.config` to define your dataset. See the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/getting-started/welcome) for comprehensive guides on column types, constraints, and processors.

```python
import data_designer.config as dd
Expand Down
6 changes: 3 additions & 3 deletions docs/data-designer/tutorials/seeding.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ description: ""

This tutorial demonstrates how to use external datasets as seed data for synthetic data generation in Data Designer.

For more detail about seed dataset behavior, see the [open-source library's version](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/tutorials/seeding-with-an-external-dataset) of this tutorial.
For more detail about seed dataset behavior, see the [open-source library's version](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/tutorials/seeding-with-an-external-dataset) of this tutorial.

## Seed Sources by Execution Mode

Expand Down Expand Up @@ -344,5 +344,5 @@ When you configure a seed dataset:
## Next Steps

- **Execution modes:** Learn more about local and NeMo Services execution in [Execution Modes](/documentation/design-synthetic-data/execution-modes)
- **Column types:** Explore all available column types in the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/concepts/columns)
- **Processors:** Transform your data with processors in the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.8.0/concepts/processors)
- **Column types:** Explore all available column types in the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/concepts/columns)
- **Processors:** Transform your data with processors in the [library documentation](https://docs.nvidia.com/nemo/datadesigner/v0.9.1/concepts/processors)
2 changes: 1 addition & 1 deletion packages/data_designer_nemo/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ requires-python = ">=3.11,<3.15"
authors = [{ name = "NVIDIA", email = "nemo@nvidia.com" }]
dependencies = [
"nemo-platform",
"data-designer==0.8.0",
"data-designer==0.9.1",
"anyio>=4.0",
"duckdb",
"pydantic>=2",
Expand Down
9 changes: 5 additions & 4 deletions packages/nemo_platform/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -85,7 +85,7 @@ core-service = [

# Generated from [tool.bundle-package]; do not edit by hand.
data-designer-nemo = [
"data-designer==0.8.0",
"data-designer==0.9.1",
"anyio>=4.0",
"duckdb",
"pydantic>=2",
Expand Down Expand Up @@ -244,8 +244,8 @@ nemo-agents-plugin = [
# Generated from [tool.bundle-package]; do not edit by hand.
nemo-anonymizer-plugin = [
"nemo-platform-plugin",
"nemo-anonymizer>=0.3.1",
"data-designer==0.8.0",
"nemo-anonymizer==0.3.3",
Comment thread
mikeknep marked this conversation as resolved.
"data-designer==0.9.1",
"data-designer-nemo",
"httpx>=0.27",
"fastapi",
Expand All @@ -266,7 +266,7 @@ nemo-auditor-plugin = [
# Generated from [tool.bundle-package]; do not edit by hand.
nemo-data-designer-plugin = [
"nemo-platform-plugin",
"data-designer==0.8.0",
"data-designer==0.9.1",
"data-designer-nemo",
"httpx>=0.27",
"fastapi",
Expand Down Expand Up @@ -581,6 +581,7 @@ anonymizer = "nemo_anonymizer_plugin.skills:get_skills_path"
guardrails = "nemo_guardrails_plugin.skills:get_skills_path"
platform = "nemo_platform.skills:skills_dir"
safe-synthesizer = "nemo_safe_synthesizer_plugin.skills:get_skills_path"

[tool.uv.sources]
nemo-platform-sdk = { workspace = true }
nemo-platform-ext = { workspace = true }
Expand Down
4 changes: 2 additions & 2 deletions plugins/nemo-anonymizer/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ authors = [{ name = "NVIDIA", email = "nemo@nvidia.com" }]
dependencies = [
"nemo-platform-plugin",
"nemo-platform",
"nemo-anonymizer>=0.3.1",
"data-designer==0.8.0",
"nemo-anonymizer==0.3.3",
"data-designer==0.9.1",
"data-designer-nemo",
"httpx>=0.27",
"fastapi",
Expand Down
4 changes: 2 additions & 2 deletions plugins/nemo-data-designer/pyproject.toml
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ authors = [{ name = "NVIDIA", email = "nemo@nvidia.com" }]
dependencies = [
"nemo-platform-plugin",
"nemo-platform",
"data-designer==0.8.0",
"data-designer==0.9.1",
"data-designer-nemo",
"httpx>=0.27",
"fastapi",
Expand Down Expand Up @@ -47,7 +47,7 @@ test = [

# Generated from [tool.bundle-package]; do not edit by hand.
data-designer-nemo = [
"data-designer==0.8.0",
"data-designer==0.9.1",
"anyio>=4.0",
"duckdb",
"pydantic>=2",
Expand Down
Loading
Loading