Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions docs/source/guides/fine-grained-tracing-with-weave.md
Original file line number Diff line number Diff line change
Expand Up @@ -59,10 +59,11 @@ This setup enables logging trace data to W&B weave. The weave integration requir
| `entity` (optional) | Your W&B username or team name | `"your-wandb-username-or-teamname"` |

### Step 4: Run Your Workflow
From the root directory of the AIQ Toolkit library, execute your workflow as shown below:
Install `simple_calculator` example using the instructions in the `examples/simple_calculator/README.md` guide.
Run the workflow using `config-weave.yml` configuration file:

```bash
aiq run --config_file examples/simple_calculator/configs/config.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
aiq run --config_file examples/simple_calculator/configs/config-weave.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
```

If it is your first time running the workflow, you will be prompted to login to W&B Weave.
Expand Down
7 changes: 7 additions & 0 deletions examples/simple_calculator/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -178,6 +178,13 @@ Workflow Result:
### Examine the Traces in Phoenix
Open your browser and navigate to `http://localhost:6006` to view the traces.

## Using Weave for Tracing
You can use Weave to trace the workflow by following the instructions in the [Fine-grained Tracing with Weave](../../docs/source/guides/fine-grained-tracing-with-weave.md) guide.
Sample usage:
```bash
aiq run --config_file examples/simple_calculator/configs/config-weave.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
```

## Accuracy Evaluation
The answers generated by the workflow can be evaluated using the [Tunable RAG Evaluator](../../docs/source/concepts/evaluate.md#tunable-rag-evaluator). A sample dataset is provided in `examples/simple_calculator/data/simple_calculator.json`.

Expand Down