Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The "content" param should be flexible: str or List #658

Closed
6 of 10 tasks
BeibinLi opened this issue Nov 13, 2023 · 1 comment
Closed
6 of 10 tasks

The "content" param should be flexible: str or List #658

BeibinLi opened this issue Nov 13, 2023 · 1 comment
Assignees
Labels
multimodal language + vision, speech etc.

Comments

@BeibinLi
Copy link
Collaborator

BeibinLi commented Nov 13, 2023

For instance, the multimodal agents use a list as "content" in messages, but standard GPT-4 and Llama based models are using string.

This basic discrepancy causes issues while two different agents are communicating with each other. An interesting bug is raised by @joshkyh while creating a GroupChat environment with two LMM agents.

Tasks

Preview Give feedback
@BeibinLi
Copy link
Collaborator Author

For reference, here is OpenAI's definition of "messages": https://platform.openai.com/docs/api-reference/messages/object

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
multimodal language + vision, speech etc.
Projects
None yet
Development

No branches or pull requests

4 participants