Skip to content

fix: MoA reference models receive empty content with prompt caching (#64416) - #64450

Closed
webtecnica wants to merge 0 commit into
NousResearch:mainfrom
webtecnica:fix/64416-moa-cache-control
Closed

fix: MoA reference models receive empty content with prompt caching (#64416)#64450
webtecnica wants to merge 0 commit into
NousResearch:mainfrom
webtecnica:fix/64416-moa-cache-control

Conversation

@webtecnica

Copy link
Copy Markdown
Contributor

Fixes #64416.

@alt-glitch alt-glitch added type/bug Something isn't working comp/agent Core agent runtime: loop, agent_init, prompt builder, context-compression, responses endpoint needs-decision Awaiting maintainer decision before any implementation P3 Low — cosmetic, nice to have labels Jul 14, 2026
@alt-glitch

Copy link
Copy Markdown
Collaborator

This was generated by AI during triage.

Heads-up: the underlying bug (#64416) already appears fixed on main by the merged #64319, which uses flatten_message_text in _reference_messages. This PR's current diff removes flatten_message_text and reintroduces the inline isinstance flattening, so its branch base looks to predate #64319 — merging as-is would revert the merged fix (including the image-only-turn placeholder and guidance-append ordering). Flagging for a maintainer to close or rebase rather than auto-treating as a duplicate.

@webtecnica webtecnica closed this Jul 14, 2026
@webtecnica
webtecnica force-pushed the fix/64416-moa-cache-control branch from 88558d9 to 46e87b1 Compare July 14, 2026 15:29
@webtecnica

Copy link
Copy Markdown
Contributor Author

Rebased onto upstream/main (46e87b1).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp/agent Core agent runtime: loop, agent_init, prompt builder, context-compression, responses endpoint needs-decision Awaiting maintainer decision before any implementation P3 Low — cosmetic, nice to have type/bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: MoA reference models receive empty content when aggregator uses prompt caching (cache_control converts string to list)

2 participants