Skip to content

Misleading error messages when users enter invalid Groq model #1368

@MikeBirdTech

Description

@MikeBirdTech

Describe the bug

This occurs when trying to use one of the new Groq models, such as llama-3.1-405b-reasoning and non-paying users do not have access. This might occur with other invalid models as well, but I haven't tested.

When the user runs interpreter --model groq/llama-3.1-405b-reasoning --api_base https://api.groq.com/openai/v1 --api_key $GROQ_API_KEY
the error is

  You do not have access to openai/groq/llama-3.1-405b-reasoning. You will need to add a payment method and purchase credits for the OpenAI API billing page (different from ChatGPT) to use `GPT-4`.

.com/account/billing/overview

Would you like to try GPT-3.5-TURBO instead? (y/n)

Reproduce

Run interpreter --model groq/llama-3.1-405b-reasoning --api_base https://api.groq.com/openai/v1 --api_key $GROQ_API_KEY

Enter any prompt

Expected behavior

An error message that is related to the provider of the model attempted to be used

Screenshots

No response

Open Interpreter version

0.3.4

Python version

3.11.7

Operating System name and version

MacOS

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions