Skip to content

Conversation

@Kvadratni
Copy link
Contributor

Pull Request Description

  • Adds additional recipe related telemetry to the UI
  • Adds tags to CLI recipe telemetry

@Kvadratni Kvadratni changed the title Add logging for recipe metadata in scheduler, UI, and CLI Add metrics for recipe metadata in scheduler, UI, and CLI Aug 28, 2025
@Kvadratni Kvadratni force-pushed the mnovich/improve-recipe-telemetry-UI branch from 531d09a to d0a1125 Compare August 28, 2025 22:58
@lifeizhou-ap
Copy link
Collaborator

Looks good, would you please test it to make sure it works. Thank you! If it works, then I'll approve it!

@Kvadratni Kvadratni merged commit b78337d into main Aug 28, 2025
11 checks passed
@Kvadratni Kvadratni deleted the mnovich/improve-recipe-telemetry-UI branch August 28, 2025 23:18
session_working_dir: String,
scheduled_job_id: Option<String>,
recipe_name: Option<String>,
recipe_version: Option<String>,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need to pass this in? do we not have this information in the session meta data, that seems like a better place. same actually for the schedule_job_id I think.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we do not have it currently no

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so we want to move the source of truth for conversations to the server, not add stuff to the reply handler. I also don't think this does record what you want it to record. I think you want to measure how often recipes are used, not how many messages users send to recipes. not that it is doing that, if you resume a conversation, it won't remember it was started by a recipe.

I would suggest to wait with this until the https://github.com/block/goose/pull/4216/files lands and then add the logging to agent/start which should know whether it was done through a recipe (and if not, that would be the right place to add).

})
.unwrap_or_else(|| "unknown".to_string()),
Err(_) => "unknown".to_string(),
};
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you filtering through the list of jobs twice here, once to find the name, once to find the version? make that into one thing

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah that's on me. let me fix this quick

session_id: chat.id,
session_working_dir: window.appConfig.get('GOOSE_WORKING_DIR'),
...(chat.recipeConfig?.title
? {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

title is required, so you want to check on recipeConfig here, not title

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's checking chat.recipeConfig?.title not hat.recipeConfig

michaelneale added a commit that referenced this pull request Aug 29, 2025
* main:
  new recipe to lint-check my code (#4416)
  removing a leftover syntax error (#4415)
  Iand/updating recipe validation workflow (#4413)
  Iand/updating recipe validation workflow (#4410)
  Fix (Ollama provider): Unsupported operation: streaming not implemented (#4303)
  change databricks default to claude sonnet 4 (#4405)
  Iand/updating recipe validation workflow (#4406)
  Add metrics for recipe metadata in scheduler, UI, and CLI (#4399)
  Iand/updating recipe validation workflow (#4403)
  making small updates to recipe validation workflow (#4401)
  Automate OpenRouter API Key Distribution for External Recipe Contributors (#3198)
  Enhance `convert_path_with_tilde_expansion` to handle Windows (#4390)
  make sure all cookbook recipes have a title and version, but no id (#4395)
  Nest TODO State in session data (#4361)
  Fast model falls back to regular (#4375)
  Update windows instructions (#4333)
lifeizhou-ap added a commit that referenced this pull request Aug 29, 2025
* main: (40 commits)
  new recipe to lint-check my code (#4416)
  removing a leftover syntax error (#4415)
  Iand/updating recipe validation workflow (#4413)
  Iand/updating recipe validation workflow (#4410)
  Fix (Ollama provider): Unsupported operation: streaming not implemented (#4303)
  change databricks default to claude sonnet 4 (#4405)
  Iand/updating recipe validation workflow (#4406)
  Add metrics for recipe metadata in scheduler, UI, and CLI (#4399)
  Iand/updating recipe validation workflow (#4403)
  making small updates to recipe validation workflow (#4401)
  Automate OpenRouter API Key Distribution for External Recipe Contributors (#3198)
  Enhance `convert_path_with_tilde_expansion` to handle Windows (#4390)
  make sure all cookbook recipes have a title and version, but no id (#4395)
  Nest TODO State in session data (#4361)
  Fast model falls back to regular (#4375)
  Update windows instructions (#4333)
  feat: linux computer control for android (termux) (#3890)
  feat: Added scroll state support for chat-session-list navigation (#4360)
  docs: typo fix (#4376)
  blog: goose janitor (#4131)
  ...
wpfleger96 added a commit to wpfleger96/goose that referenced this pull request Aug 29, 2025
…tensions-on-resume

* upstream/main: (60 commits)
  [cookbook recipe] Update Wording  (block#4438)
  feat: show enabled extensions at top of extensions page (block#4423)
  test recipe (block#4436)
  Extensions loading indicator on desktop launch (block#4412)
  removing trailing slash (block#4433)
  [recipe cookbook] test recipe (block#4431)
  [recipe cookbook] switching to SHA (block#4429)
  [recipe cookbook] Update url build (block#4427)
  [Recipe Cookbook] test recipe flow (block#4426)
  [Recipe cookbook] Addressing GitHub api format issue (block#4424)
  feat: integrate tool call icons with status indicators and daisy chaining (block#4279)
  new recipe to lint-check my code (block#4416)
  removing a leftover syntax error (block#4415)
  Iand/updating recipe validation workflow (block#4413)
  Iand/updating recipe validation workflow (block#4410)
  Fix (Ollama provider): Unsupported operation: streaming not implemented (block#4303)
  change databricks default to claude sonnet 4 (block#4405)
  Iand/updating recipe validation workflow (block#4406)
  Add metrics for recipe metadata in scheduler, UI, and CLI (block#4399)
  Iand/updating recipe validation workflow (block#4403)
  ...
This was referenced Sep 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants