microsoft · sonichi · Feb 11, 2024 · Feb 7, 2024 · Feb 7, 2024 · Feb 7, 2024
diff --git a/notebook/agentchat_RetrieveChat.ipynb b/notebook/agentchat_RetrieveChat.ipynb
@@ -103,7 +103,7 @@
    "source": [
     "\\:\\:\\:tip\n",
     "\n",
-    "Learn more about the various ways to configure LLM endpoints [here](/docs/llm_endpoint_configuration).\n",
+    "Learn more about the various ways to configure LLM endpoints [here](/docs/llm_configuration).\n",
     "\n",
     "\\:\\:\\:"
    ]

diff --git a/notebook/agentchat_auto_feedback_from_code_execution.ipynb b/notebook/agentchat_auto_feedback_from_code_execution.ipynb
@@ -61,7 +61,7 @@
    "source": [
     "\\:\\:\\:tip\n",
     "\n",
-    "Learn more about the various ways to configure LLM endpoints [here](/docs/llm_endpoint_configuration).\n",
+    "Learn more about the various ways to configure LLM endpoints [here](/docs/llm_configuration).\n",
     "\n",
     "\\:\\:\\:"
    ]

diff --git a/notebook/agentchat_cost_token_tracking.ipynb b/notebook/agentchat_cost_token_tracking.ipynb
@@ -102,7 +102,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_function_call.ipynb b/notebook/agentchat_function_call.ipynb
@@ -103,7 +103,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_function_call_async.ipynb b/notebook/agentchat_function_call_async.ipynb
@@ -61,7 +61,7 @@
    "source": [
     "\\:\\:\\:tip\n",
     "\n",
-    "Learn more about the various ways to configure LLM endpoints [here](/docs/llm_endpoint_configuration).\n",
+    "Learn more about the various ways to configure LLM endpoints [here](/docs/llm_configuration).\n",
     "\n",
     "\\:\\:\\:"
    ]

diff --git a/notebook/agentchat_function_call_currency_calculator.ipynb b/notebook/agentchat_function_call_currency_calculator.ipynb
@@ -106,7 +106,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_groupchat.ipynb b/notebook/agentchat_groupchat.ipynb
@@ -107,7 +107,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_groupchat_RAG.ipynb b/notebook/agentchat_groupchat_RAG.ipynb
@@ -101,7 +101,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_groupchat_research.ipynb b/notebook/agentchat_groupchat_research.ipynb
@@ -93,7 +93,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_groupchat_vis.ipynb b/notebook/agentchat_groupchat_vis.ipynb
@@ -110,7 +110,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_human_feedback.ipynb b/notebook/agentchat_human_feedback.ipynb
@@ -102,7 +102,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_langchain.ipynb b/notebook/agentchat_langchain.ipynb
@@ -139,7 +139,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_oai_assistant_groupchat.ipynb b/notebook/agentchat_oai_assistant_groupchat.ipynb
@@ -62,7 +62,7 @@
     "]\n",
     "```\n",
     "\n",
-    "Currently Azure OpenAI does not support assistant api. You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "Currently Azure OpenAI does not support assistant api. You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_stream.ipynb b/notebook/agentchat_stream.ipynb
@@ -102,7 +102,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/agentchat_two_users.ipynb b/notebook/agentchat_two_users.ipynb
@@ -82,7 +82,7 @@
     "]\n",
     "```\n",
     "\n",
-    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+    "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
    ]
   },
   {

diff --git a/notebook/contributing.md b/notebook/contributing.md
@@ -52,7 +52,7 @@ Then after the code cell where this is used, include the following markdown snip
 ```
 \:\:\:tip
 
-Learn more about the various ways to configure LLM endpoints [here](/docs/llm_endpoint_configuration).
+Learn more about the various ways to configure LLM endpoints [here](/docs/llm_configuration).
 
 \:\:\:
 ```
diff --git a/website/.gitignore b/website/.gitignore
@@ -11,7 +11,7 @@ package-lock.json
 docs/reference
 /docs/notebooks
 
-docs/llm_endpoint_configuration.mdx
+docs/llm_configuration.mdx
 
 # Misc
 .DS_Store

diff --git a/website/docs/Examples.md b/website/docs/Examples.md
@@ -88,7 +88,7 @@ Links to notebook examples:
 ## Enhanced Inferences
 ### Utilities
 - API Unification  - [View Documentation with Code Example](https://microsoft.github.io/autogen/docs/Use-Cases/enhanced_inference/#api-unification)
-- Utility Functions to Help Managing API configurations effectively - [View Notebook](/docs/llm_endpoint_configuration)
+- Utility Functions to Help Managing API configurations effectively - [View Notebook](/docs/llm_configuration)
 - Cost Calculation - [View Notebook](https://github.com/microsoft/autogen/blob/main/notebook/oai_client_cost.ipynb)
 
 ### Inference Hyperparameters Tuning

diff --git a/website/docs/FAQ.md b/website/docs/FAQ.md
@@ -21,67 +21,15 @@
 
 ## Set your API endpoints
 
-Autogen relies on 3rd party API endpoints for LLM inference. It works great with OpenAI and Azure OpenAI models, and can work with any model (self-hosted or local) that is accessible through an inference server compatible with OpenAI Chat Completions API.
-
-An agent requires a list of configuration dictionaries for setting up model endpoints. Each configuration dictionary can contain the following keys:
-- `model` (str): Required. The identifier of the model to be used, such as 'gpt-4', 'gpt-3.5-turbo', or 'llama-7B'.
-- `api_key` (str): Optional. The API key required for authenticating requests to the model's API endpoint.
-- `api_type` (str): Optional. The type of API service being used. This could be 'azure' for Azure Cognitive Services, 'openai' for OpenAI, or other custom types.
-- `base_url` (str): Optional. The base URL of the API endpoint. This is the root address where API calls are directed.
-- `api_version` (str): Optional. The version of the Azure API you wish to use
-
-For example:
-```python
-config_list = [
-    {
-        "model": "gpt-4",
-        "api_key": os.environ.get("AZURE_OPENAI_API_KEY"),
-        "api_type": "azure",
-        "base_url": os.environ.get("AZURE_OPENAI_API_BASE"),
-        "api_version": "2023-12-01-preview",
-    },
-    {
-        "model": "llama-7B",
-        "base_url": "http://127.0.0.1:8080",
-        "api_type": "openai",
-    }
-]
-```
-
-In `autogen` module there are [multiple helper functions](/docs/reference/oai/openai_utils) allowing to construct configurations using different sources:
-
-- `get_config_list`: Generates configurations for API calls, primarily from provided API keys.
-- `config_list_openai_aoai`: Constructs a list of configurations using both Azure OpenAI and OpenAI endpoints, sourcing API keys from environment variables or local files.
-- `config_list_from_json`: Loads configurations from a JSON structure, either from an environment variable or a local JSON file, with the flexibility of filtering configurations based on given criteria.
-- `config_list_from_models`: Creates configurations based on a provided list of models, useful when targeting specific models without manually specifying each configuration.
-- `config_list_from_dotenv`: Constructs a configuration list from a `.env` file, offering a consolidated way to manage multiple API configurations and keys from a single file.
-
-We suggest that you take a look at this [notebook](/docs/llm_endpoint_configuration) for full code examples of the different methods to configure your model endpoints.
+This documentation has been moved [here](/docs/llm_configuration).
 
 ### Use the constructed configuration list in agents
 
-Make sure the "config_list" is included in the `llm_config` in the constructor of the LLM-based agent. For example,
-```python
-assistant = autogen.AssistantAgent(
-    name="assistant",
-    llm_config={"config_list": config_list}
-)
-```
-
-The `llm_config` is used in the [`create`](/docs/reference/oai/client#create) function for LLM inference.
-When `llm_config` is not provided, the agent will rely on other openai settings such as `openai.api_key` or the environment variable `OPENAI_API_KEY`, which can also work when you'd like to use a single endpoint.
-You can also explicitly specify that by:
-```python
-assistant = autogen.AssistantAgent(name="assistant", llm_config={"api_key": ...})
-```
+This documentation has been moved [here](/docs/llm_configuration).
 
 ### How does an agent decide which model to pick out of the list?
 
-An agent uses the very first model available in the "config_list" and makes LLM calls against this model. If the model fail (e.g. API throttling) the agent will retry the request against the 2nd model and so on until  prompt completion is received (or throws an error if none of the models successfully completes the request). There's no implicit/hidden logic inside agents that is used to pick "the best model for the task". It is developers responsibility to pick the right models and use them with agents.
-
-Besides throttling/rotating models the 'config_list' can be useful for:
-- Having a single global list of models and [filtering it](/docs/reference/oai/openai_utils/#filter_config) based on certain keys (e.g. name, tag) in order to pass select models into a certain agent (e.g. use cheaper GPT 3.5 for agents solving easier tasks)
-- Using more advanced features for special purposes related to inference, such as `filter_func` with [`OpenAIWrapper`](/docs/reference/oai/client#create) or [inference optimization](/docs/Examples#enhanced-inferences)
+This documentation has been moved [here](/docs/llm_configuration#how-does-an-agent-decide-which-model-to-pick-out-of-the-list).
 
 ### Unexpected keyword argument 'base_url'
 

diff --git a/website/docs/Getting-Started.md b/website/docs/Getting-Started.md
@@ -18,7 +18,7 @@ AutoGen is powered by collaborative [research studies](/docs/Research) from Micr
 
 ### Quickstart
 
-Install from pip: `pip install pyautogen`. Find more options in [Installation](/docs/Installation).
+Install from pip: `pip install pyautogen`. Find more options in [Installation](/docs/installation/).
 For [code execution](/docs/FAQ#code-execution), we strongly recommend installing the python docker package, and using docker.
 
 #### Multi-Agent Conversation Framework

diff --git a/website/docs/Use-Cases/enhanced_inference.md b/website/docs/Use-Cases/enhanced_inference.md
@@ -279,7 +279,7 @@ For convenience, we provide a number of utility functions to load config lists.
 - `config_list_from_models`: Creates configurations based on a provided list of models, useful when targeting specific models without manually specifying each configuration.
 - `config_list_from_dotenv`: Constructs a configuration list from a `.env` file, offering a consolidated way to manage multiple API configurations and keys from a single file.
 
-We suggest that you take a look at this [notebook](/docs/llm_endpoint_configuration) for full code examples of the different methods to configure your model endpoints.
+We suggest that you take a look at this [notebook](/docs/llm_configuration) for full code examples of the different methods to configure your model endpoints.
 
 ### Logic error
-Original file line number
+Diff line change
@@ Expand Up / @@ -102,7 +102,7 @@ @@
         "]\n",
         "```\n",
         "\n",
-        "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_endpoint_configuration.ipynb) for full code examples of the different methods."
+        "You can set the value of config_list in any way you prefer. Please refer to this [notebook](https://github.com/microsoft/autogen/blob/main/website/docs/llm_configuration.ipynb) for full code examples of the different methods."
        ]
       },
       {
@@ Expand Down @@