[Feature Request]: Integrate more model calling to AutoGen through API

[yiranwu0]

Is your feature request related to a problem? Please describe.

Besides OpenAI and Gemini Integration, there are existing other models that are available through API calling. It would be helpful if AutoGen could provide an uniform interface for calling different models.
Specifically, the following models could be added:

• Mistral: https://mistral.ai/technology/
• Claude: https://www.anthropic.com/api
• Various open-source models are supported by providers that allow easy usage through function calling. For example Deepinfra: https://deepinfra.com/. It is wrapped with OpenAI class, which is easy to implement.

Describe the solution you'd like

No response

Additional context

No response

Tasks

Preview Give feedback

1. Allow passing in custom pricing in config_list #2902
   +0
   
2. [Bug]: Gemini missing message in history #2900
   bug +1
3. Mistral Client #2892
   models tool-usage +2
   
4. Uniform Interface for calling different LLMs #2916
   +0
5. Anthropic Client #2931
   models tool-usage +2
   
6. Together AI Client #2919
   models +1
   

[Hk669]

@marklysze as mentioned yesterday, can i know if you are working on the anthropic? ive seen the TogetherAI draft PR #2919. i can work on anthropic client if it is not implemented already. thanks

[marklysze]

@marklysze as mentioned yesterday, can i know if you are working on the anthropic? ive seen the TogetherAI draft PR #2919. i can work on anthropic client if it is not implemented already. thanks

Hi @Hk669, thanks for checking, sorry it is the Together AI client I was working on. I'm not working on the Anthropic client but there is a notebook with a sample Anthropic custom client class in the non-openai topic in documentation that could help with the new class. Happy to test if you can work on the class.

[Hk669]

@marklysze as mentioned yesterday, can i know if you are working on the anthropic? ive seen the TogetherAI draft PR #2919. i can work on anthropic client if it is not implemented already. thanks

Hi @Hk669, thanks for checking, sorry it is the Together AI client I was working on. I'm not working on the Anthropic client but there is a notebook witt a sample Anthropic custom client class in the non-openai topic in documentation that could help with the new class. Happy to test if you can work on the class.

Sure, thanks for the clarification.

[Hk669]

@yiranwu0 , i believe we can close this issue.