Custom Model Client support

[olgavrou]

Why are these changes needed?

This PR adds support for custom client calls to be made. The idea is that the user can specify their own custom client class and load it into the configuration (e.g. for loading local models). As long as they adhere to the Client class's interface and response protocol then everything should work fine with only this addition to the config (full usage shown in the unit test):

So if we have the class CustomClient the class name (as a string) needs to be set as the api_type in the config:

config_list = [
    {
        "model": "local_model_name",
        "model_client_cls" = "CustomClient",
        "device": "cuda",
        "params": {
            "max_length": 1000,
            "temperature": 1.1,
            [other params that will be consumed in the Custom Client so user has full control over what is set and what is consumed]
        }
    }
]

Then once an agent is created the custom client can be registered:

agent.register_custom_client(CustomClient, [optional other args for the constuctor of CustomClient])

Notes:
Ideally the client interface would not live under a directory called oai and the client wrapper wouldn't be called OpenAIWrapper but something more generic, but that can be examined at a later date

Related PR

Replaces #831 and has less refactoring done so that the change is more contained

Checks

• I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

[codecov-commenter]

Codecov Report

Attention: 97 lines in your changes are missing coverage. Please review.

Comparison is base (b0c1f8d) 33.12% compared to head (1ea55cc) 46.59%.

❗ Current head 1ea55cc differs from pull request most recent head 479696c. Consider uploading reports for the commit 479696c to get more accurate results

Files	Patch %	Lines
autogen/oai/client.py	39.62%	88 Missing and 8 partials ⚠️
autogen/agentchat/conversable_agent.py	66.66%	1 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##             main    #1345       +/-   ##
===========================================
+ Coverage   33.12%   46.59%   +13.47%     
===========================================
  Files          42       42               
  Lines        5051     5112       +61     
  Branches     1157     1239       +82     
===========================================
+ Hits         1673     2382      +709     
+ Misses       3250     2530      -720     
- Partials      128      200       +72     

Flag	Coverage Δ
unittests	46.53% <40.49%> (+13.45%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[ekzhu]

Just want to say I am so happy it is merged finally!

[marklysze]

Fantastic work, thank you