Studio: Show Run button for downloaded non-GGUF models in the Model Hub by oobabooga · Pull Request #7001 · unslothai/unsloth

oobabooga · 2026-07-09T01:42:28Z

Downloaded non-GGUF models (safetensors, MLX, adapters, checkpoints) got no Run button in the Model Hub. Reported on Discord for MLX on Mac, but it affects every non-GGUF format on every OS. The model still loads from the main chat dropdown, so this was purely a Hub-UI gap, not a loader gap.

Problem

#6152 turned the post-download Run button on for GGUF, but non-GGUF cards stayed behind HUB_POST_DOWNLOAD_ACTIONS_VISIBLE, which is still false because it also gates the not-yet-shipped New Chat / Train pickers. So a downloaded non-GGUF card showed no Run button while GGUF showed one.

Fix

Give non-GGUF Run its own flag (HUB_NON_GGUF_RUN_ACTIONS_VISIBLE = true), like the GGUF one, keeping New Chat / Train hidden until those pickers ship. Run wires to the existing load handlers; no backend change.

What changes in the UI:

A downloaded safetensors model, adapter, or checkpoint shows a Run button in the Hub. Clicking it loads the model into chat, same as the dropdown.
Models the machine can't actually run don't get a live button: unsupported formats (e.g. MLX on a non-Mac, including untagged mlx-community repos) and any non-GGUF model on a host with no GPU or usable MLX show a disabled state instead, with a "GGUF-only device" chip explaining the host case.
GGUF cards are unchanged.

Verification

Ran main and the PR side by side. A downloaded safetensors model shows no Run on main and a working Run on the PR: it loads and chat works. GGUF cards are identical on both. mlx-community repos show the "May not be supported" chip on a CUDA host. Typecheck green.

gemini-code-assist

Code Review

This pull request introduces a new feature flag, HUB_NON_GGUF_RUN_ACTIONS_VISIBLE, to decouple the post-download Run CTA for non-GGUF models from the HUB_POST_DOWNLOAD_ACTIONS_VISIBLE flag. This allows running non-GGUF models independently of the Hub-aware chat/train pickers. The review feedback points out a visual inconsistency in LocalOnDeviceCard where a vertical divider is still gated by HUB_POST_DOWNLOAD_ACTIONS_VISIBLE instead of runActionsVisible, preventing it from rendering when only the Run button is visible. It is recommended to update this condition to ensure consistency with SafetensorsDownloadCard.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

gemini-code-assist · 2026-07-09T01:44:00Z

  const runActionsVisible = isGguf
    ? HUB_GGUF_RUN_ACTIONS_VISIBLE
-    : HUB_POST_DOWNLOAD_ACTIONS_VISIBLE;
+    : HUB_NON_GGUF_RUN_ACTIONS_VISIBLE;


With runActionsVisible now decoupled from HUB_POST_DOWNLOAD_ACTIONS_VISIBLE for non-GGUF models, there is a visual inconsistency in LocalOnDeviceCard.

The vertical divider separating the metadata/path buttons from the action buttons (around line 560) is still gated by HUB_POST_DOWNLOAD_ACTIONS_VISIBLE:

{onTrain && HUB_POST_DOWNLOAD_ACTIONS_VISIBLE && ( <div aria-hidden="true" className="ml-1 mr-0 h-5 w-px shrink-0 bg-foreground/[0.06] ..." /> )}

Because HUB_POST_DOWNLOAD_ACTIONS_VISIBLE is false, this divider is never rendered when only the Run button is visible (which affects both GGUF and non-GGUF models). This differs from SafetensorsDownloadCard, which correctly displays the divider when runActionsVisible is true.

To fix this visual bug and ensure consistency, the divider in LocalOnDeviceCard should be updated to key off runActionsVisible instead:

{runActionsVisible && ( <div aria-hidden="true" className="ml-1 mr-0 h-5 w-px shrink-0 bg-foreground/[0.06] opacity-100 transition-opacity duration-150 group-hover/dl:opacity-0 dark:bg-white/[0.04]" /> )}

Not fixing: the GGUF Run CTA already omits this divider before its button (gguf-download-card.tsx, {!isGgufRunCta && <CardDivider />}), so no divider before Run is the shipped design intent, not a bug. Keying it off runActionsVisible instead would newly add a divider before the GGUF on-device Run button, which is the wrong direction.

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 35b07b7aaf

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector · 2026-07-09T01:49:59Z

+// Hub-aware chat/train pickers (GGUF already ships it), so it enables
+// independently of HUB_POST_DOWNLOAD_ACTIONS_VISIBLE, which still gates the
+// New Chat / Train pickers.
+export const HUB_NON_GGUF_RUN_ACTIONS_VISIBLE = true;


Gate non-GGUF Run on support status

When this flag is true, both non-GGUF cards show Run based only on canRun, but canRunModel is derived from runtimeCapabilities.canChat and does not include the existing unsupported-format classification. In a downloaded MLX-format safetensors repo on a non-Mac device, classifyUnslothSupport marks MLX unsupported while inventory still reports safetensors can_chat, so this exposes a Run button for a model the inspector says is only safe to download, leading users into a load path we already classify as unsupported. Please fold the support status into the non-GGUF Run gate or the canRun prop.

Useful? React with 👍 / 👎.

Confirmed and fixed in 1b030fa: canRunModel only checked runtimeCapabilities.canChat, which defaults true for safetensors regardless of classifyUnslothSupport. Now non-GGUF also requires unslothSupport.status !== "unsupported", so an unsupported-format repo (e.g. MLX on non-Mac) falls back to the existing disabled Run state instead of exposing an enabled button.

oobabooga · 2026-07-09T03:04:03Z

@codex review

chatgpt-codex-connector · 2026-07-09T03:08:18Z

Codex Review: Something went wrong. Try again later by commenting “@codex review”.

Unknown error

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

oobabooga · 2026-07-09T04:13:52Z

@codex review

oobabooga · 2026-07-09T04:14:04Z

@codex review

chatgpt-codex-connector · 2026-07-09T04:19:16Z

Codex Review: Didn't find any major issues. 🚀

Reviewed commit: 1b030fa967

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

oobabooga · 2026-07-13T19:05:14Z

@codex review

chatgpt-codex-connector · 2026-07-13T19:09:07Z

Codex Review: Didn't find any major issues. Keep it up!

Reviewed commit: e8d5e0a925

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

oobabooga · 2026-07-13T19:24:34Z

@codex review

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e0e511cac1

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

oobabooga · 2026-07-13T20:25:24Z

@codex review

chatgpt-codex-connector · 2026-07-13T20:30:15Z

Codex Review: Didn't find any major issues. 🎉

Reviewed commit: a530a2fd84

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

oobabooga added 2 commits July 8, 2026 19:24

Studio: Show Run button for downloaded non-GGUF models in the Model Hub

d6e6557

Trim redundant comments and correct non-GGUF flag scope note

35b07b7

gemini-code-assist Bot reviewed Jul 9, 2026

View reviewed changes

chatgpt-codex-connector Bot reviewed Jul 9, 2026

View reviewed changes

Gate non-GGUF Run on Unsloth support status

1b030fa

oobabooga mentioned this pull request Jul 9, 2026

[staging CI] unslothai/unsloth#7001 oobabooga/unsloth#40

Closed

Hide the safetensors card divider before a lone Run button

e8d5e0a

oobabooga added 2 commits July 13, 2026 16:14

Deduplicate the run and train gate expressions

b8d3f3f

Correct stale feature-flag and divider comments

e0e511c

chatgpt-codex-connector Bot reviewed Jul 13, 2026

View reviewed changes

Comment thread studio/frontend/src/features/hub/catalog/model-inspector.tsx Outdated

Comment thread studio/frontend/src/features/hub/catalog/model-inspector.tsx Outdated

Comment thread studio/frontend/src/features/hub/catalog/model-inspector.tsx Outdated

oobabooga added 2 commits July 13, 2026 16:51

Gate non-GGUF Run on host capability and catch untagged MLX repos

3a109a9

Explain the disabled Run state on chat-only hosts

a530a2f

oobabooga mentioned this pull request Jul 13, 2026

CI: Hub non-GGUF Run button (#7001 mirror) oobabooga/unsloth#52

Open

oobabooga merged commit 76d7088 into unslothai:main Jul 13, 2026
36 checks passed

danielhanchen mentioned this pull request Jul 19, 2026

Studio: do not show Run for embedding-only non-GGUF models in the Model Hub #7245

Merged

This was referenced Jul 22, 2026

fix/pr 7333 persisted plugin repro ci Imagineer99/unsloth#48

Closed

fix/pr 7328 positional repro ci Imagineer99/unsloth#49

Closed

Uh oh!

Conversation

oobabooga commented Jul 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Problem

Fix

Verification

Uh oh!

gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

Code Review

Uh oh!

gemini-code-assist Bot Jul 9, 2026

Choose a reason for hiding this comment

Uh oh!

oobabooga Jul 9, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

chatgpt-codex-connector Bot Jul 9, 2026

Choose a reason for hiding this comment

Uh oh!

oobabooga Jul 9, 2026

Choose a reason for hiding this comment

Uh oh!

oobabooga commented Jul 9, 2026

Uh oh!

chatgpt-codex-connector Bot commented Jul 9, 2026

Uh oh!

oobabooga commented Jul 9, 2026

Uh oh!

oobabooga commented Jul 9, 2026

Uh oh!

chatgpt-codex-connector Bot commented Jul 9, 2026

Uh oh!

oobabooga commented Jul 13, 2026

Uh oh!

chatgpt-codex-connector Bot commented Jul 13, 2026

Uh oh!

oobabooga commented Jul 13, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

oobabooga commented Jul 13, 2026

Uh oh!

chatgpt-codex-connector Bot commented Jul 13, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

oobabooga commented Jul 9, 2026 •

edited

Loading