Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG]: failed to load the native whisper model #1157

Closed
help4bis opened this issue Apr 21, 2024 · 1 comment
Closed

[BUG]: failed to load the native whisper model #1157

help4bis opened this issue Apr 21, 2024 · 1 comment
Labels
needs info / can't replicate Issues that require additional information and/or cannot currently be replicated, but possible bug

Comments

@help4bis
Copy link

How are you running AnythingLLM?

Docker (local)

What happened?

Uploading a large mp4 file to a "virgin" installation creates the following error.

Part of .env file
LLM_PROVIDER='ollama'
OPEN_AI_KEY='sk-xxxxxxxxxxxxxxx'
EMBEDDING_MODEL_PREF='wizardlm2:latest'
OLLAMA_BASE_PATH='http://xxxxxx7:11434'
OLLAMA_MODEL_PREF='wizardlm2:latest'
OLLAMA_MODEL_TOKEN_LIMIT='2048'
EMBEDDING_ENGINE='native'
EMBEDDING_BASE_PATH='http://xxxxxxxx7:11434'
EMBEDDING_MODEL_MAX_CHUNK_LENGTH='6144'
VECTOR_DB='lancedb'

Error:
wisperError.txt

[LocalWhisper] Failed to load the native whisper model: Error: Unsupported model type: whisper
at AutoModelForCTC.from_pretrained (file:///app/collector/node_modules/@xenova/transformers/src/models.js:4667:19)
at async file:///app/collector/node_modules/@xenova/transformers/src/pipelines.js:2677:33
node:internal/process/promises:288
triggerUncaughtException(err, true /* fromPromise */);
^

Error: Unsupported model type: whisper
at AutoModelForCTC.from_pretrained (file:///app/collector/node_modules/@xenova/transformers/src/models.js:4667:19)
at async file:///app/collector/node_modules/@xenova/transformers/src/pipelines.js:2677:33

Node.js v18.19.1

Are there known steps to reproduce?

Scenario:

  1. uploading large MP4 about 300mb
  2. Native whisper model has not run before.
@help4bis help4bis added the possible bug Bug was reported but is not confirmed or is unable to be replicated. label Apr 21, 2024
@timothycarambat
Copy link
Member

Duplicate of #539
Related library convo: huggingface/transformers.js#314

If running on docker are you building the image for the proper processor arch that the OS is running? That was the root cause last time. Docker was running the model in an emulated x86 environment and it was incompatible running on an ARM chip

@timothycarambat timothycarambat added needs info / can't replicate Issues that require additional information and/or cannot currently be replicated, but possible bug and removed possible bug Bug was reported but is not confirmed or is unable to be replicated. labels Apr 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs info / can't replicate Issues that require additional information and/or cannot currently be replicated, but possible bug
Projects
None yet
Development

No branches or pull requests

2 participants