Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[.Net][Feature Request]: Support prompt cache in claude #3359

Closed
LittleLittleCloud opened this issue Aug 15, 2024 · 1 comment
Closed

[.Net][Feature Request]: Support prompt cache in claude #3359

LittleLittleCloud opened this issue Aug 15, 2024 · 1 comment
Assignees
Labels
dotnet issues related to AutoGen.Net

Comments

@LittleLittleCloud
Copy link
Collaborator

Is your feature request related to a problem? Please describe.

Claude now support prompt cache, which dramastically lower the bill if cache is hit.

https://www.anthropic.com/news/prompt-caching

Describe the solution you'd like

Add the corresponding option in claude client

Additional context

No response

@LittleLittleCloud LittleLittleCloud added enhancement dotnet issues related to AutoGen.Net labels Aug 15, 2024
@DavidLuong98 DavidLuong98 self-assigned this Aug 15, 2024
@marklysze
Copy link
Collaborator

Very cool feature. Would be good to update the Anthropic client class in Python as well. I'll try and get that done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dotnet issues related to AutoGen.Net
Projects
None yet
Development

No branches or pull requests

3 participants