Claude cache

[funkpopo]

@seefs001
能帮我审查一下这次改动吗？对于Claude的缓存我不太熟悉，想学习一下。非常感谢！

作为new-api而不是商业中转，我的改动是否符合new-api的需求？

Summary by CodeRabbit

• New Features
  • Introduced prompt caching optimization for Claude requests to improve performance and reduce latency.
  • Added automatic user metadata injection to support enhanced routing and session consistency.
  • Added configuration options to enable or disable automatic cache control and metadata injection features.

[coderabbitai]

Caution

Review failed

The pull request is closed.

Walkthrough

This pull request adds prompt caching optimization and metadata injection to Claude API requests. It introduces two helper functions (injectSystemCacheControl and injectMetadataUserId) for conditionally applying ephemeral cache control and user metadata to requests, integrates them into the request construction pipeline, and adds two new configuration flags to control this behavior.

Changes

Cohort / File(s)	Summary
Claude Request Processing relay/channel/claude/relay-claude.go, relay/channel/claude/adaptor.go	Introduces injectSystemCacheControl and injectMetadataUserId helper functions to conditionally append ephemeral cache control and attach user metadata (token_id) to Claude requests. Integrates helpers into request conversion flow; note that injectMetadataUserId is called twice in the flow (potential duplication).
Claude Configuration setting/model_setting/claude.go	Adds two new boolean configuration fields (AutoInjectCacheControl and AutoInjectMetadataUserId) to control automatic injection of cache control and user metadata, with documentation explaining their purpose for prompt caching and sticky routing.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~20 minutes

Possibly related PRs

• fix: claude & gemini endpoint system prompt overwrite #1850: Modifies Claude request system-prompt handling in the request-construction flow with similar message injection logic.

Suggested reviewers

• seefs001
• Calcium-Ion

Poem

🐰 Whiskers twitched with cache delight,
System prompts now gleam so bright,
Metadata flows through tunnels deep,
Ephemeral guards our secrets keep!
Relay hops with joy and care,
Optimization floats through air ✨

✨ Finishing touches

• 📝 Generate docstrings

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment

Tip

Issue Planner is now in beta. Read the docs and try it out! Share your feedback on Discord.

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}