Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions docs/source/guides/fine-grained-tracing-with-weave.md
Original file line number Diff line number Diff line change
Expand Up @@ -59,10 +59,11 @@ This setup enables logging trace data to W&B weave. The weave integration requir
| `entity` (optional) | Your W&B username or team name | `"your-wandb-username-or-teamname"` |

### Step 4: Run Your Workflow
From the root directory of the AIQ Toolkit library, execute your workflow as shown below:
Install `simple_calculator` example using the instructions in [A Simple LLM Calculator](../../../examples/simple_calculator/README.md) guide.
Run the workflow using `config-weave.yml` configuration file:

```bash
aiq run --config_file examples/simple_calculator/configs/config.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
aiq run --config_file examples/simple_calculator/configs/config-weave.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
```

If it is your first time running the workflow, you will be prompted to login to W&B Weave.
Expand Down
7 changes: 7 additions & 0 deletions examples/simple_calculator/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -178,6 +178,13 @@ Workflow Result:
### Examine the Traces in Phoenix
Open your browser and navigate to `http://localhost:6006` to view the traces.

## Using Weave for Tracing
You can use Weave to trace the workflow by following the instructions in the [Fine-grained Tracing with Weave](../../docs/source/guides/fine-grained-tracing-with-weave.md) guide.
Sample usage:
```bash
aiq run --config_file examples/simple_calculator/configs/config-weave.yml --input "Is the product of 2 * 4 greater than the current hour of the day?"
```

## Accuracy Evaluation
The answers generated by the workflow can be evaluated using the [Tunable RAG Evaluator](../../docs/source/concepts/evaluate.md#tunable-rag-evaluator). A sample dataset is provided in `examples/simple_calculator/data/simple_calculator.json`.

Expand Down
Loading