MultimodalGroupChat #1142
Comments
|
@BeibinLi we should also consider what a universal solution would be here. E.g., similar to #1129, it would be nice if we had a layer somewhere that allowed messages that AutoGen uses to diverge from the messages we send to the LLM (e.g., passing only a subset of the fields). This would also help with instrumentation (Cheng is working on that). |
Good point. I am thinking about redesign the multimodal features as a "Capability" in @rickyloynd-microsoft #1091 Regarding #1129, I will make a comment there. |
…icrosoft#1142) * simplify the initiation of chat * version update * include openai * completion * load config list from json * initiate_chat * oai config list * oai config list * config list * config_list * raise_error * retry_time * raise condition * oai config list * catch file not found * catch openml error * handle openml error * handle openml error * handle openml error * handle openml error * handle openml error * handle openml error * close microsoft#1139 * use property * termination msg * AIUserProxyAgent * smaller dev container * update notebooks * match * document code execution and AIUserProxyAgent * gpt 3.5 config list * rate limit * variable visibility * remove unnecessary import * quote * notebook comments * remove mathchat from init import * two users * import location * expose config * return str not tuple * rate limit * ipython user proxy * message * None result * rate limit * rate limit * rate limit * rate limit * make auto_reply a common method for all agents * abs path * refactor and doc * set mathchat_termination * code format * modified * emove import * code quality * sender -> messages * system message * clean agent hierarchy * dict check * invalid oai msg * return * openml error * docstr --------- Co-authored-by: kevin666aa <[email protected]>
Is your feature request related to a problem? Please describe.
The group chat does not work well with multimodal agents, because the group chat manager could not parse image information.
Related Issues:
#1087
Describe the solution you'd like
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: