Feature Request: AI Alternative - Anthropic / Self-Hosted

[PrestoMac]

Hey Dev Team!
First off, huge kudos for creating AppFlowy! It's amazing to see the capabilities that are possible with an open-source alternative to Notion.

I wanted to put in a request for the ability to use alternate AI models besides just OpenAI, specifically Anthropic's Claude or a self-hosted model.

Some potential benefits of allowing different models:

• Gives users more choice and control over their data and interactions
• Allows for customization to suit different needs or preferences
• Enables using models that may be more affordable, private, or aligned with certain values
• Fosters competition and innovation between AI providers
• Future-proofs AppFlowy as new models emerge

I imagine there could be some complexities to implement this, but wanted to get your thoughts given the momentum and interest around AI assistants nowadays. Even just supporting Claude as an option alongside GPT would be awesome!

Let me know if any additional context would help or if you have any other feedback. Loving AppFlowy so far and excited to see where you take it next!

[AnsahMohammad]

Expanding on that idea, an excellent addition would be the capability to integrate various open-source AI models. Many of these models operate without the necessity for tokens, enabling users to harness the power of AI effortlessly within their workflow
Advantages :

• Incorporate AI directly into their workflow
• No need to sign in and generate a token

Disadvantages :

• Some of the models will be less accurate ( Solution: Select only high-quality models)
• May confuse the user with a lot of options ( Solution: Add the options to switch to various AI Models in the settings and not in the main selection area)

[Fau57]

Llama.cpp or llama.rn integration for pc - mobile should work, imho

[richardstevenhack]

I agree. "Your data is yours forever" is not true if using OpenAI, especially since they just appointed a former NSA director to the board. I trust only local AIs for my private notes. It's fine having the ability to use a cloud AI but it should not be limited to that. I can use cloud and local AIs with Obsidian.

[annieappflowy]

Thanks, everyone on this thread. Our vision for AppFlowy AI is accessible, collaborative, and contextual.
Accessible:

• Everyone can run AI on their machine - ultimate privacy, no GPU or Internet required
• Access to advanced models - GPT4O, Claude 3, and more
• Please bear with us as it takes time to realize our vision. We will be enabling Claude 3 soon, and then local AI will come next.

#4529

[red-co]

Here you only need to support openai_api, all other ai service providers provide openai_api compatibility. It is not necessary to implement the code for five different modes.
just like "meta_ai, Amazon ai, Microsoft cloud ai, Google cloud ai, more others ai, aiaiaiaiai, next_gen_gtp5_killer",