Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documenting how to add more models #49

Open
Utopiah opened this issue Sep 16, 2024 · 2 comments
Open

Documenting how to add more models #49

Utopiah opened this issue Sep 16, 2024 · 2 comments

Comments

@Utopiah
Copy link

Utopiah commented Sep 16, 2024

Hi, great project! I'm wondering how one can add more models. I'm thinking of e.g STT and TTS using CoquiAI or Whisper.cpp.

How do you recommend I do so rather than changing one of the current model by another?

@Josh-XT Josh-XT closed this as completed Sep 16, 2024
@Josh-XT Josh-XT reopened this Sep 16, 2024
@Josh-XT
Copy link
Collaborator

Josh-XT commented Sep 16, 2024

Screenshot_20240916-074637

Hello! Please expand the "Environment Variables" section in the readme. You'll want to use the hugging face URL for a GGUF model repository.

For example: https://huggingface.co/QuantFactory/Phi-3.5-mini-instruct-GGUF would just be QuantFactory/Phi-3.5-mini-instruct-GGUF

@Utopiah
Copy link
Author

Utopiah commented Sep 16, 2024

Thanks I'll try. Actually most of what you provide probably covers my need. I could enable all providers (as you linked before in https://josh-xt.github.io/AGiXT/2-Concepts/02-Providers.html ) to ezLocalai then whatever HF model available (maybe selected via https://llm.extractum.io for the available configuration, e.g under VRAM limit) if not the one you already selected.

Does it mean as-is ezlocalai is fully local and can work offline once properly setup?

isn't fully local and thus wouldn't work offline, due to relying on some remote API calls e.g Google (gTTS) as default for TTS? My bad seems gTTS isn't an API.

Also, and more out of curiosity, if I want to add another provider (I hope it's the right term) to do for example 3D model generation (using e.g TripoSR or shape-E) how would I do that correctly?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants