You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
1. Fix the name of the config file used for weave tracing
2. Add a note in the simple calculator readme for weave tracing usage
Signed-off-by: Anuradha Karuppiah <[email protected]>
Copy file name to clipboardExpand all lines: docs/source/guides/fine-grained-tracing-with-weave.md
+3-2Lines changed: 3 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -59,10 +59,11 @@ This setup enables logging trace data to W&B weave. The weave integration requir
59
59
|`entity` (optional) | Your W&B username or team name |`"your-wandb-username-or-teamname"`|
60
60
61
61
### Step 4: Run Your Workflow
62
-
From the root directory of the AIQ Toolkit library, execute your workflow as shown below:
62
+
Install `simple_calculator` example using the instructions in [A Simple LLM Calculator](https://github.com/NVIDIA/aiq/blob/main/examples/simple_calculator/README.md) guide.
63
+
Run the workflow using `config-weave.yml` configuration file:
63
64
64
65
```bash
65
-
aiq run --config_file examples/simple_calculator/configs/config.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
66
+
aiq run --config_file examples/simple_calculator/configs/config-weave.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
66
67
```
67
68
68
69
If it is your first time running the workflow, you will be prompted to login to W&B Weave.
Copy file name to clipboardExpand all lines: examples/simple_calculator/README.md
+7Lines changed: 7 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -178,6 +178,13 @@ Workflow Result:
178
178
### Examine the Traces in Phoenix
179
179
Open your browser and navigate to `http://localhost:6006` to view the traces.
180
180
181
+
## Using Weave for Tracing
182
+
You can use Weave to trace the workflow by following the instructions in the [Fine-grained Tracing with Weave](../../docs/source/guides/fine-grained-tracing-with-weave.md) guide.
183
+
Sample usage:
184
+
```bash
185
+
aiq run --config_file examples/simple_calculator/configs/config-weave.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
186
+
```
187
+
181
188
## Accuracy Evaluation
182
189
The answers generated by the workflow can be evaluated using the [Tunable RAG Evaluator](../../docs/source/concepts/evaluate.md#tunable-rag-evaluator). A sample dataset is provided in `examples/simple_calculator/data/simple_calculator.json`.
0 commit comments