Skip to content

Latency issue fix with prepare_inference#535

Merged
zakiali merged 1 commit into
v1.0from
zaki/instantiate_token_counter_once
Jan 2, 2025
Merged

Latency issue fix with prepare_inference#535
zakiali merged 1 commit into
v1.0from
zaki/instantiate_token_counter_once

Add TokenCounter to Agent struct to only instantiate once

45a48f4
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs