Skip to content

lmstudio: 0.3.6 -> 0.3.7#375373

Closed
crertel wants to merge 3 commits intoNixOS:masterfrom
crertel:lmstudio-0.3.7
Closed

lmstudio: 0.3.6 -> 0.3.7#375373
crertel wants to merge 3 commits intoNixOS:masterfrom
crertel:lmstudio-0.3.7

Conversation

@crertel
Copy link
Contributor

@crertel crertel commented Jan 20, 2025

Update to 0.3.7:

  • New: Support for DeepSeek R1! -> Requires also updating your llama.cpp engine to 1.9.2.
  • New: Hardware tab in Mission Control. Open with Cmd/Ctrl + Shift + H.
  • New: Added a server file logging mode option that gives you finer control over what gets logged in the log files.
  • New: KV Cache quantization for llama.cpp models (requires llama.cpp/1.9.0+ runtime)
  • Added support for nulls in Open AI compatible API server.
  • Fixed prediction queueing not working. (queued prediction will return empty results)
  • Show runtime update notifications only for currently used runtimes
  • Added a descriptive error when LM Studio fails to start due to lack of file system access.
  • Fixed a bug where sometimes JIT model loading can cause an error
  • Fixed a bug where engine extension's output had an extraneous new line in logs
  • Fixed a bug where sometimes two chats will be created for new users.

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@crertel
Copy link
Contributor Author

crertel commented Jan 20, 2025

@eeedean it's that time again--need a Mac friend. <3

@crertel crertel requested a review from eeedean January 20, 2025 19:58
@github-actions github-actions bot added 10.rebuild-darwin: 1 This PR causes 1 package to rebuild on Darwin. 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-linux: 1 This PR causes 1 package to rebuild on Linux. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux. labels Jan 20, 2025
@nix-owners nix-owners bot requested a review from cig0 January 20, 2025 20:06
@eeedean
Copy link
Contributor

eeedean commented Jan 20, 2025

The build worked out just fine. However, looks like LM Studio doesn't want to be launched from the Nix Store anymore:
image

That's very unfortunate. I wrote a Mail at LM Studios Team and hope for some solution. If there wont be a solution from LM Studio, we may be forced to remove the package from the repository.

@crertel
Copy link
Contributor Author

crertel commented Jan 21, 2025

Ah hell. :(

@eeedean
Copy link
Contributor

eeedean commented Jan 21, 2025

Yeah, Mac Apps do Mac App-Things sometimes (all the time 😄 )..
Anyway: I got an answer and they will be loosening the check a little. Objective was to avoid launch from the dmg image. I asked, if we were to await a revision or if it will be fixed in the next release.

As soon as I get new information, I'll inform you promptly.

Linux users can leverage an overlay to get the most recent release of the app. I think, we should therefore wait for at least the answer from the LM Studio-Team.

@crertel
Copy link
Contributor Author

crertel commented Jan 21, 2025

@eeedean Sounds good to me--I'm even lazier and am just using appimage-run in the meantime. 😅 I'll leave this up and once we hear back I'll update the revision.

@vanishingideal
Copy link

Yeah, Mac Apps do Mac App-Things sometimes (all the time 😄 ).. Anyway: I got an answer and they will be loosening the check a little. Objective was to avoid launch from the dmg image. I asked, if we were to await a revision or if it will be fixed in the next release.

As soon as I get new information, I'll inform you promptly.

Linux users can leverage an overlay to get the most recent release of the app. I think, we should therefore wait for at least the answer from the LM Studio-Team.

Just a heads up that 0.3.8 was released.

@eeedean
Copy link
Contributor

eeedean commented Jan 26, 2025

Yeah, Mac Apps do Mac App-Things sometimes (all the time 😄 ).. Anyway: I got an answer and they will be loosening the check a little. Objective was to avoid launch from the dmg image. I asked, if we were to await a revision or if it will be fixed in the next release.
As soon as I get new information, I'll inform you promptly.
Linux users can leverage an overlay to get the most recent release of the app. I think, we should therefore wait for at least the answer from the LM Studio-Team.

Just a heads up that 0.3.8 was released.

Unfortunately 0.3.8 is still faulty in this regard. Thanks for the heads up nevertheless! Much appreciated 😸!

@crertel
Copy link
Contributor Author

crertel commented Jan 30, 2025

@eeedean it's up to 0.3.9 now if you'd be so kind (for testing, to see if we're good to try this again). <3

@eeedean
Copy link
Contributor

eeedean commented Jan 30, 2025

image Same thing :( I'll write them again.

@eeedean
Copy link
Contributor

eeedean commented Feb 3, 2025

0.3.9 revision 6 is still broken on macOS:
image

I'm kinda open to just marking it as broken on macOS. Don't know the exact process in nixpkgs for that, but I think, it may be reasonable to at least provide NixOS package consumers with the most recent version of the package.

@crertel
Copy link
Contributor Author

crertel commented Feb 3, 2025

As a Linux user, I'm obviously fine with that approach--still, a damned shame.

@camilosampedro
Copy link

I also tried installing it on aarch64-darwin, but when trying to open it, it gives this warning:
Screenshot 2025-02-04 at 12 25 00

It may be related to #373630

Copy link
Contributor

@eeedean eeedean left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @crertel , could you please

  • update to 0.3.9
  • mark aarch64-darwin as broken

I'd like to get this merged, to have the most recent version handy for NixOS users.

@crertel
Copy link
Contributor Author

crertel commented Feb 12, 2025

@eeedean roger wilco, will try to have this done by this weekend. Thanks again for being my mac testing fren. :)

@deftdawg
Copy link
Contributor

Darwin will eventually get fixed upstream via the fix promised for this issue: lmstudio-ai/lmstudio-bug-tracker#347

I also tried installing it on aarch64-darwin, but when trying to open it, it gives this warning: Screenshot 2025-02-04 at 12 25 00

For these type of app error's I've see xattr -cr /Applications/<YOUR_APP>.app sometimes fix this by nuking all extended attributes... DeepSeek says this can commonly be be due to quarantine which it thinks is more safely removed using xattr -d com.apple.quarantine /path/to/App.app, so maybe try that first before -cr

@crertel
Copy link
Contributor Author

crertel commented Feb 20, 2025

@eeedean 0.3.10 is out...I'll update this for that tonight.

@deftdawg
Copy link
Contributor

@eeedean 0.3.10 is out...I'll update this for that tonight.

Speculative Decoding is good stuff.

Probably should go ahead and mark Darwin as broken until LM Studio fix this lmstudio-ai/lmstudio-bug-tracker#347

@crertel
Copy link
Contributor Author

crertel commented Feb 20, 2025

Okay, combining the breakage on Mac and update to 0.3.10 over in a new PR #383546 . Closing this for now.

@crertel crertel closed this Feb 20, 2025
@wegank wegank mentioned this pull request Jun 14, 2025
13 tasks
@crertel crertel deleted the lmstudio-0.3.7 branch January 16, 2026 05:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-darwin: 1 This PR causes 1 package to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux. 10.rebuild-linux: 1 This PR causes 1 package to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants