Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"mixtral-8x22b" is gone from 0.3.3.4 version ;-( #2359

Open
manatlan opened this issue Nov 15, 2024 · 5 comments
Open

"mixtral-8x22b" is gone from 0.3.3.4 version ;-( #2359

manatlan opened this issue Nov 15, 2024 · 5 comments
Assignees
Labels
bug Something isn't working

Comments

@manatlan
Copy link
Contributor

"mixtral-8x22b" is gone ;-(

you can see it (dynamic list, ordered by nb of providers, of the models) :

import g4f
all=[]
for model in g4f.models._all_models:
    m=g4f.models.ModelUtils.convert[model]
    o=m.best_provider
    if o is None:
        ll=[]
    elif isinstance(o,g4f.providers.retry_provider.IterListProvider):
        ll=o.providers
    else:
        ll=[o]
    all.append( (m.name, m.base_provider, len(ll),[i.__name__ for i in ll]) )

all.sort(key=lambda x: -x[2])
for model,society,nb,providers in all:
        print(nb,model,f"({society})",providers)

@manatlan manatlan added the bug Something isn't working label Nov 15, 2024
@TheFirstNoob
Copy link

@manatlan Hi, Yes, unfortunately there are currently no providers for this model or they work extremely unstable. If they are, the model will be returned back. Please check out other models for yourself here: https://github.com/xtekky/gpt4free/blob/main/g4f/models.py#L91

@manatlan
Copy link
Contributor Author

but it worked well for me this morning, with 0.3.3.3 ...

@TheFirstNoob
Copy link

I check providers for 22b models on 0.3.3.3. Model is gone.

DeepInfra: https://deepinfra.com/chat
Airforce: https://api.airforce/v1/models

@TheFirstNoob
Copy link

Update info;
Model will be restored on next update from Airforce provider!

@hqnicolas
Copy link

hqnicolas commented Nov 21, 2024

@manatlan I'm keeping 3 servers running at same time here....
port 1337 for updated version
port 1338 for v0.3.3.3
port 1339 for @kqlio67 version
port 1340 for v0.3.3.4

git clone --branch 1338 https://github.com/hqnicolas/continue4free.git
git clone --branch 1339 https://github.com/hqnicolas/continue4free.git
git clone --branch 1340 https://github.com/hqnicolas/continue4free.git

image

image

image

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants