Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

bug: Model using CPU instead of GPU #4053

Closed
1 of 3 tasks
imtuyethan opened this issue Nov 20, 2024 · 3 comments
Closed
1 of 3 tasks

bug: Model using CPU instead of GPU #4053

imtuyethan opened this issue Nov 20, 2024 · 3 comments
Assignees
@louis-menlo
Labels
category: observability Logs, telemetry, crash reports P1: important Important feature / fix type: bug Something isn't working
Milestone
v0.5.9

Comments

@imtuyethan
Copy link
Contributor

Jan version

0.5.8

Describe the Bug

https://discord.com/channels/1107178041848909847/1306684719181729802

The app detects the NVIDIA RTX 3060 GPU but fails to utilize it, defaulting to CPU for model inference instead. When attempting to run models:

  1. Model shows "starting" status but fails to start
  2. When regenerating, CPU usage spikes to 100% while GPU remains unused
  3. Cortex server fails to start properly with ENOENT error

Steps to Reproduce

  1. Launch Jan v0.5.8
  2. Attempt to start any model
  3. Observe model fails to start or uses CPU instead of GPU

Screenshots / Logs

Device: Dell XPS 9710 laptop
CPU: Intel i7-11800H
GPU: NVIDIA RTX 3060
OS: Windows

What is your OS?

  • MacOS
  • Windows
  • Linux
@imtuyethan imtuyethan added the type: bug Something isn't working label Nov 20, 2024
@github-project-automation github-project-automation bot moved this to Investigating in Menlo Nov 20, 2024
@imtuyethan imtuyethan added this to the v0.5.9 milestone Nov 20, 2024
@imtuyethan imtuyethan added category: observability Logs, telemetry, crash reports P1: important Important feature / fix labels Nov 20, 2024
@imtuyethan
Copy link
Contributor Author

Moving to another patch of bug fixes (v0.5.10).

@imtuyethan imtuyethan modified the milestones: v0.5.9, v0.5.10 Nov 20, 2024
@imtuyethan imtuyethan moved this from Investigating to Scheduled in Menlo Nov 22, 2024
@imtuyethan
Copy link
Contributor Author

Screenshot 2024-11-22 at 1 16 47 PM

It only loads on CPU

@imtuyethan imtuyethan mentioned this issue Nov 27, 2024
Closed
3 tasks
@imtuyethan
Copy link
Contributor Author

Screenshot 2024-11-27 at 4 15 20 PM

Deprecated issue

@github-project-automation github-project-automation bot moved this from Scheduled to Review + QA in Menlo Nov 27, 2024
@imtuyethan imtuyethan modified the milestones: v0.5.10, v0.5.9 Nov 27, 2024
@imtuyethan imtuyethan moved this from Review + QA to Completed in Menlo Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@louis-menlo louis-menlo

Labels
category: observability Logs, telemetry, crash reports P1: important Important feature / fix type: bug Something isn't working
Projects
Menlo
Archived in project
Milestone
v0.5.9
Development

No branches or pull requests
2 participants
@imtuyethan @louis-menlo