From 4c86eedca201456410f563a03f8da4f7604efd19 Mon Sep 17 00:00:00 2001 From: Olaoluwa Salami Date: Sun, 26 Nov 2023 14:32:38 +0000 Subject: [PATCH 1/6] wip --- website/docs/Examples/AgentChat.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/website/docs/Examples/AgentChat.md b/website/docs/Examples/AgentChat.md index 908b626c4295..d2ae0f4cd37f 100644 --- a/website/docs/Examples/AgentChat.md +++ b/website/docs/Examples/AgentChat.md @@ -36,6 +36,8 @@ Links to notebook examples: - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) + - **DALLE** Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) + 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) From f885f84d249832d54862ef9182cdbf4c0049c271 Mon Sep 17 00:00:00 2001 From: Olaoluwa Salami Date: Sun, 26 Nov 2023 14:33:39 +0000 Subject: [PATCH 2/6] remove spaces --- website/docs/Examples/AgentChat.md | 1 - 1 file changed, 1 deletion(-) diff --git a/website/docs/Examples/AgentChat.md b/website/docs/Examples/AgentChat.md index d2ae0f4cd37f..c834a0b47a8f 100644 --- a/website/docs/Examples/AgentChat.md +++ b/website/docs/Examples/AgentChat.md @@ -38,7 +38,6 @@ Links to notebook examples: - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) - **DALLE** Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) - 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) - Teach Agents New Facts, User Preferences and Skills Beyond Coding - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teachability.ipynb) From 8fe50a443b1dc8eb2b8ac7194a1f4c0469cafb98 Mon Sep 17 00:00:00 2001 From: Olaoluwa Salami Date: Sun, 26 Nov 2023 14:35:06 +0000 Subject: [PATCH 3/6] : --- website/docs/Examples/AgentChat.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/Examples/AgentChat.md b/website/docs/Examples/AgentChat.md index c834a0b47a8f..ed54fcf6ad80 100644 --- a/website/docs/Examples/AgentChat.md +++ b/website/docs/Examples/AgentChat.md @@ -36,7 +36,7 @@ Links to notebook examples: - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) - - **DALLE** Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) + - **DALLE**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) From ea06a47075595145ce534705027e9ff477c79cd2 Mon Sep 17 00:00:00 2001 From: Olaoluwa Salami Date: Sun, 26 Nov 2023 15:04:23 +0000 Subject: [PATCH 4/6] pr updated --- website/docs/Use-Cases/agent_chat.md | 1 + 1 file changed, 1 insertion(+) diff --git a/website/docs/Use-Cases/agent_chat.md b/website/docs/Use-Cases/agent_chat.md index 1e4c0ed35901..64f22a6d9008 100644 --- a/website/docs/Use-Cases/agent_chat.md +++ b/website/docs/Use-Cases/agent_chat.md @@ -110,6 +110,7 @@ The figure below shows six examples of applications built using AutoGen. - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_langchain.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) + - **DALLE**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) From e14041f27e7f23dd5db1d6d3a78966253ab18b8b Mon Sep 17 00:00:00 2001 From: Olaoluwa Salami Date: Sun, 26 Nov 2023 23:26:09 +0000 Subject: [PATCH 5/6] change to wip --- website/docs/Examples/AgentChat.md | 2 +- website/docs/Use-Cases/agent_chat.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/website/docs/Examples/AgentChat.md b/website/docs/Examples/AgentChat.md index ed54fcf6ad80..02c5758cd3c9 100644 --- a/website/docs/Examples/AgentChat.md +++ b/website/docs/Examples/AgentChat.md @@ -36,7 +36,7 @@ Links to notebook examples: - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) - - **DALLE**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) + - **Multimodal**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) diff --git a/website/docs/Use-Cases/agent_chat.md b/website/docs/Use-Cases/agent_chat.md index 64f22a6d9008..b93db72da522 100644 --- a/website/docs/Use-Cases/agent_chat.md +++ b/website/docs/Use-Cases/agent_chat.md @@ -110,7 +110,7 @@ The figure below shows six examples of applications built using AutoGen. - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_langchain.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) - - **DALLE**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) + - **Multimodal**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) From dfa857de1ec9b4f08c51f14347e2fd61d035f774 Mon Sep 17 00:00:00 2001 From: Olaoluwa Salami Date: Mon, 27 Nov 2023 00:38:38 +0000 Subject: [PATCH 6/6] Created a new subsection --- website/docs/Examples/AgentChat.md | 6 +++++- website/docs/Use-Cases/agent_chat.md | 6 +++++- 2 files changed, 10 insertions(+), 2 deletions(-) diff --git a/website/docs/Examples/AgentChat.md b/website/docs/Examples/AgentChat.md index 02c5758cd3c9..5d3cd6b1d404 100644 --- a/website/docs/Examples/AgentChat.md +++ b/website/docs/Examples/AgentChat.md @@ -36,7 +36,6 @@ Links to notebook examples: - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_function_call.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) - - **Multimodal**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) @@ -48,3 +47,8 @@ Links to notebook examples: - Chat with OpenAI Assistant with Code Interpreter - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_oai_code_interpreter.ipynb) - Chat with OpenAI Assistant with Retrieval Augmentation - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_oai_assistant_retrieval.ipynb) - OpenAI Assistant in a Group Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_oai_assistant_groupchat.ipynb) + +7. **Multimodal Agent** + - Multimodal Agent Chat with DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) + - Multimodal Agent Chat with Llava - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_lmm_llava.ipynb) + - Multimodal Agent Chat with GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_lmm_gpt-4v.ipynb) diff --git a/website/docs/Use-Cases/agent_chat.md b/website/docs/Use-Cases/agent_chat.md index b93db72da522..56725d954e94 100644 --- a/website/docs/Use-Cases/agent_chat.md +++ b/website/docs/Use-Cases/agent_chat.md @@ -110,7 +110,6 @@ The figure below shows six examples of applications built using AutoGen. - Task Solving with Langchain Provided Tools as Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_langchain.ipynb) - **RAG**: Group Chat with Retrieval Augmented Generation (with 5 group member agents and 1 manager agent) - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_groupchat_RAG.ipynb) - In-depth Guide to OpenAI Utility Functions - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_openai_utils.ipynb) - - **Multimodal**: Agent Chat with Multimodal Models: DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) 5. **Agent Teaching and Learning** - Teach Agents New Skills & Reuse via Automated Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_teaching.ipynb) @@ -123,6 +122,11 @@ The figure below shows six examples of applications built using AutoGen. - Chat with OpenAI Assistant with Retrieval Augmentation - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_oai_assistant_retrieval.ipynb) - OpenAI Assistant in a Group Chat - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_oai_assistant_groupchat.ipynb) +7. **Multimodal Agent** + - Multimodal Agent Chat with DALLE and GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_dalle_and_gpt4v.ipynb) + - Multimodal Agent Chat with Llava - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_lmm_llava.ipynb) + - Multimodal Agent Chat with GPT-4V - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/agentchat_lmm_gpt-4v.ipynb) + ## For Further Reading _Interested in the research that leads to this package? Please check the following papers._