Compatible with the OpenAI api

[allenhaozi]

Feature request

Do you have any suggestions on how to be more compatible with the OpenAI api?

Motivation

like https://github.com/go-skynet/LocalAI or https://github.com/lm-sys/FastChat

Your contribution

discuss