Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Cerebras Integration #3574

Closed
wants to merge 3 commits into from
Closed

Add Cerebras Integration #3574

wants to merge 3 commits into from

Conversation

henrytwo
Copy link
Contributor

Why are these changes needed?

Add integration for Cerebras, which provides super low-latency, high speed LLM inference. Currently Llama 3.1-8B/70B are supported.

Tool calling examples have been provided in this PR, which also function with streaming. Additionally, token cost calculations have been implemented.

Checks

@henrytwo
Copy link
Contributor Author

@microsoft-github-policy-service agree company="Cerebras"

@henrytwo
Copy link
Contributor Author

cc: @marklysze, seems like you're working in this area of the codebase :)

@henrytwo henrytwo closed this by deleting the head repository Sep 30, 2024
@henrytwo
Copy link
Contributor Author

Moved to autogenhub#48

@jackgerrits
Copy link
Member

I see you closed this, did you still want us to review this?

@henrytwo
Copy link
Contributor Author

henrytwo commented Sep 30, 2024

I see you closed this, did you still want us to review this?

Yes I still want it to be reviewed, but on Discord I was told to open the PR in the Autogen org instead

@afourney afourney self-requested a review September 30, 2024 17:43
@jackgerrits
Copy link
Member

We'd be happy to review. Would you be able to reopen it so we're able to merge?

@henrytwo
Copy link
Contributor Author

@jackgerrits it won't let me reopen this PR, but I opened another one here: #3585

@jackgerrits
Copy link
Member

Sounds good thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants