Stream token usage on every agent message #5342

katzdave · 2025-10-23T20:27:02Z

Token usage gets saved to the session every turn, so just pull that.

Some clientside renames to make more clear what each token means
Make sure we always sum input + output tokens -> total tokens even if the provider doesn't provide

* 'main' of github.com:block/goose: Break compaction back into check_ and do_ compaction (#5212) fix: revert built app name to uppercase Goose (#5206) feat: add Code Documentation Generator recipe (#5121) (#5125) Revert "feat: enhance goose to search sessions for easy recall (#5177)" (#5209)

* 'main' of github.com:block/goose: Rewrite extension management tools (#5057) fix: re-sync package-lock.json (#5235) docs: Hacktoberfest MCP youtube short entry to community-content.json (#5150) feat: add schedule button to recipe entries (#5217) Autocompact threshold UI cleanup (#5232) fix: correct schema for openai tools (#5229)

* 'main' of github.com:block/goose: docs: provide more clarity in tagging step of releases (#5269) docs: add GOOSE_DEBUG environment variable (#5265) Lifei/UI parameter input (#5222) turn off WAL (#5203) Skip subagents for gemini (#5257) Revert "Standardize Session Name Attribute" (#5250) improve provider request logging a bit (#5236) Fix OpenAI empty choices panic (#5248) Revert "Rewrite extension management tools" (#5243) Standardize Session Name Attribute (#5085) Docs: Include step-by-step model configuration instructions for first… (#5239) Delete message visibility filter (#5216) delete flaky pricing integration tests (#5207) chore: upgrade most npm packages to latest (#5185) Release/1.11.0 (#5224)

* 'main' of github.com:block/goose: Feat/smart task organizer recipe (#5032) docs: `goose recipe open` command (#5264)

Changes: - Replace "manual-compact" command with "/compact" for better UX - Remove all traces of setChatState exposure from TypeScript codebase - Remove setMessages prop from ChatInput component The setChatState exposure was a bad abstraction that enabled incorrect state manipulation. Now state is controlled entirely by the server through message content, with only internal useState usage remaining. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <[email protected]>

…message * 'main' of github.com:block/goose: Add bottom menu extension selection (#5352)

zanesq · 2025-10-28T17:12:29Z

@katzdave can you resolve the conflicts when you get a chance?

katzdave · 2025-10-28T18:38:22Z

@katzdave can you resolve the conflicts when you get a chance?

Done

zanesq

LGTM tested locally and token count is much better.

One question: what happens when multiple agents/requests update the same session concurrently would it lose the updates?

zanesq · 2025-10-28T21:11:46Z

ui/desktop/src/hooks/useChatStream.ts

  setRecipeUserParams: (values: Record<string, string>) => Promise<void>;
  stopStreaming: () => void;
  sessionLoadError?: string;
+  tokenState?: TokenState;


Should this be optional? When would tokenState not be available?

Fixed; had thought it was more widely used.

zanesq · 2025-10-28T21:56:31Z

I think this fixes #3538 also in my testing

katzdave · 2025-10-28T23:40:21Z

LGTM tested locally and token count is much better.

One question: what happens when multiple agents/requests update the same session concurrently would it lose the updates?

I think it should be fine, since all of the updates are just pulling the latest state from the session on every message.

I think this fixes #3538 also in my testing

Nice! I think desktop will need one more small fix for this but, very close.

* 'main' of github.com:block/goose: (81 commits) nextcamp - fix session resume when navigating back to chat in sidebar (#5370) feat/fix: set optional config params, and don't overwrite unset secrets (#5325) Stringly typed config (#5463) Fix: Compaction client <-> server sync (#5481) docs: recipe activity parameter substitution (#5462) only run fork on branch PRs (#5461) docs: video on goose with apify mcp (#5472) Clear windows and fix build failure (#5452) Add menu option for setting window always on top (#5429) Delete environment variable (#5479) chore: upgrade rmcp to 0.8.3 (#5458) docs: add "Building Custom Tools and Extensions for Goose" (#5469) Doc (Blog): Managing goose Configurations Across Multiple Projects (#5467) apify doc fix (#5460) Stream token usage on every agent message (#5342) rpm install in /opt/Goose to avoid conflicts with chrome-sandbox (#5421) Don't disable extensions after they fail to activate in new chat session (#5464) Add OTLP logs layer (#5386) openapi to locust load test generator recipe (#5447) technical debt tracker recipe (#5451) ... # Conflicts: # ui/desktop/src/components/ChatInput.tsx

* main: (45 commits) Change Recipes Test Script (#5457) Goose recover (#5450) don't start the default provider (#5351) keep the order of keys in config.yaml (#5468) Removed drafts and agentIsReady in ChatInput (#5366) nextcamp - fix session resume when navigating back to chat in sidebar (#5370) feat/fix: set optional config params, and don't overwrite unset secrets (#5325) Stringly typed config (#5463) Fix: Compaction client <-> server sync (#5481) docs: recipe activity parameter substitution (#5462) only run fork on branch PRs (#5461) docs: video on goose with apify mcp (#5472) Clear windows and fix build failure (#5452) Add menu option for setting window always on top (#5429) Delete environment variable (#5479) chore: upgrade rmcp to 0.8.3 (#5458) docs: add "Building Custom Tools and Extensions for Goose" (#5469) Doc (Blog): Managing goose Configurations Across Multiple Projects (#5467) apify doc fix (#5460) Stream token usage on every agent message (#5342) ...

Signed-off-by: fbalicchia <[email protected]>

Signed-off-by: Blair Allan <[email protected]>

katzdave and others added 30 commits October 16, 2025 13:36

first wave refactor

15224fb

rename conversation compacted content

a795429

fmt

814de07

undo rename

af08051

rm some comments

69b66f2

rm compactioncheckresult

60aca5e

rm autocompactresult

d0098b3

massive rename fun

38f00fe

continue renames

97aa4ab

massive code delete

3689708

clean up reply

f9dada8

force user only on system notifications

c2139de

update notificiaiton

b0e1dd3

client side compact msg

293a696

fix typecheck

85d446e

experimental big thinking msg change

a3c5278

simplify slightly

8acc16c

Merge branch 'main' of github.com:block/goose into dkatz/system-notify

46e8c14

* 'main' of github.com:block/goose: Feat/smart task organizer recipe (#5032) docs: `goose recipe open` command (#5264)

cli support

e1c9b62

msg string

44f1674

fmt

2f623d4

minor cleanup

ecb523a

rm a couple more comments

22db6f8

setMessage cleanup in progress

9151686

big change -> client streams compact message

4925dba

remove messy do_compaction abstraction

dfddf3e

katzdave added 8 commits October 24, 2025 15:10

don't pass usage to message

250fabe

lingering usage refs

8be519b

fmt

f3aa252

rename currenTtotalTokens

d8af0a0

cleanup diff

1c2ffcc

merge

e1045fb

move to openapi schema

66bfef0

Merge branch 'main' of github.com:block/goose into dkatz/token-usage-…

560e05b

…message * 'main' of github.com:block/goose: Add bottom menu extension selection (#5352)

katzdave marked this pull request as ready for review October 24, 2025 21:47

merge conflicts

f05e74f

katzdave added 4 commits October 28, 2025 15:51

rm openapi

8dad9e9

regen schema

2e26a6c

merge with schema

63230e0

schema gen

79c05af

katzdave requested review from DOsinga and zanesq October 28, 2025 20:09

zanesq approved these changes Oct 28, 2025

View reviewed changes

dont use optionsals

3f21655

one more optional ref

0dd473d

katzdave merged commit 37e1bb1 into main Oct 30, 2025
25 of 28 checks passed

katzdave deleted the dkatz/token-usage-message branch October 30, 2025 03:23

github-actions bot mentioned this pull request Nov 5, 2025

chore(release): release version 1.13.0 (minor) #5582

Merged

fbalicchia pushed a commit to fbalicchia/goose that referenced this pull request Nov 7, 2025

Stream token usage on every agent message (block#5342)

d21e070

Signed-off-by: fbalicchia <[email protected]>

BlairAllan pushed a commit to BlairAllan/goose that referenced this pull request Nov 29, 2025

Stream token usage on every agent message (block#5342)

ee37cb3

Signed-off-by: Blair Allan <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Stream token usage on every agent message #5342

Stream token usage on every agent message #5342

Uh oh!

katzdave commented Oct 23, 2025 •

edited

Loading

Uh oh!

zanesq commented Oct 28, 2025

Uh oh!

katzdave commented Oct 28, 2025

Uh oh!

zanesq left a comment

Uh oh!

zanesq Oct 28, 2025

Uh oh!

katzdave Oct 28, 2025

Uh oh!

zanesq commented Oct 28, 2025

Uh oh!

katzdave commented Oct 28, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Stream token usage on every agent message #5342

Stream token usage on every agent message #5342

Uh oh!

Conversation

katzdave commented Oct 23, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

zanesq commented Oct 28, 2025

Uh oh!

katzdave commented Oct 28, 2025

Uh oh!

zanesq left a comment

Choose a reason for hiding this comment

Uh oh!

zanesq Oct 28, 2025

Choose a reason for hiding this comment

Uh oh!

katzdave Oct 28, 2025

Choose a reason for hiding this comment

Uh oh!

zanesq commented Oct 28, 2025

Uh oh!

katzdave commented Oct 28, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

katzdave commented Oct 23, 2025 •

edited

Loading