feat(honcho): optional lightweight cached startup context for recallMode=tools - #2164
feat(honcho): optional lightweight cached startup context for recallMode=tools#2164teyrebaz33 wants to merge 1 commit into
Conversation
|
Whoops didn't catch that ! I implemented my version, have you had any success testing yours ? |
|
Thanks for this contribution. Closing because the architecture it targets no longer exists: The ideas here are still good — the current plugin already has prewarm infrastructure for |
Closes #2150
What
Adds an opt-in background prewarm for
recallMode=toolsthat fetches a small user snapshot (representation + peer card) from Honcho on/newor session reset, and injects it into the first real turn's user message.How
HonchoClientConfig: newtools_startup_context: bool = Falsefield (JSON key:toolsStartupContext)HonchoSessionManager.fetch_startup_snapshot(peer_id): fetches user representation + peer card without requiring an active session in local cacherun_agent.py:_schedule_honcho_startup_prewarm()fires a daemon thread on session init;_pop_startup_snapshot()consumes it once on first turncli.py: prewarm triggered innew_session()gateway/run.py: prewarm triggered after reset,_honcho_startup_cachekeyed bypeer_nameDesign decisions
_honcho_turn_context(user message append), not_honcho_context(system prompt) — prompt cache prefix stays stablepop()semantics — consumed exactly once, subsequent turns unaffectednot conversation_historyguard — first turn onlypeer_name(stable Honcho identity), not ephemeral session IDNot included (by design)
Continuity-style recall is intentionally excluded per issue spec —
/newsemantically means a fresh session.