Skip to content

localai 3.1.0 #228298

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
BrewTestBot wants to merge 1 commit into from
Closed

localai 3.1.0 #228298

BrewTestBot wants to merge 1 commit into from

Conversation

@BrewTestBot
Copy link
Contributor

@BrewTestBot BrewTestBot commented Jun 26, 2025

Created by brew bump

Created with brew bump-formula-pr.

  • resource blocks have been checked for updates.
release notes 

  

   



🚀 LocalAI 3.1



🚀 Highlights


Support for Gemma 3n!


Gemma 3n has been released and it's now available in LocalAI (currently only for text generation, install it with:


    

  • local-ai run gemma-3n-e2b-it
    • 

  • local-ai run gemma-3n-e4b-it
    • 



⚠️ Breaking Changes


Several important changes that reduce image size, simplify the ecosystem, and pave the way for a leaner LocalAI core:


🧰 Container Image Changes


    

  • Sources are no longer bundled in the container images. This significantly reduces image sizes.

      

    • Need to rebuild locally? Just follow the docs to build from scratch. We're working towards migrating all backends to the gallery, slimming down the default image further.
      • 

    

    • 



📁 Directory Structure Updated


New default model and backend paths for container images:


    

  • Models: /models/ (was /build/models)
    • 

  • Backends: /backends/ (was /build/backends)
    • 



🏷 Unified Image Tag Naming for master (development) builds


We've cleaned up and standardized container image tags for clarity and consistency:


    

  • gpu-nvidia-cuda11 and gpu-nvidia-cuda12 (previously cublas-cuda11, cublas-cuda12)
    • 

  • gpu-intel-f16 and gpu-intel-f32 (previously sycl-f16, sycl-f32)
    • 



Meta packages in backend galleries


We’ve introduced meta-packages to the backend gallery!

These packages automatically install the most suitable backend depending on the GPU detected in your system — saving time, reducing errors, and ensuring you get the right setup out of the box. These will be added as soon as the 3.1.0 images are going to be published, stay tuned!


For instance, you will be able to install vllm just by installing the vllm backend in the gallery ( no need to select anymore the correct GPU version)


The Complete Local Stack for Privacy-First AI


With LocalAGI rejoining LocalAI alongside LocalRecall, our ecosystem provides a complete, open-source stack for private, secure, and intelligent AI operations:



  

    
      
        LocalAI Logo
        
LocalAI

      
    		
    
      
The free, Open Source OpenAI alternative. Acts as a drop-in replacement REST API compatible with OpenAI specifications for local AI inferencing. No GPU required.

      
Link: https://github.com/mudler/LocalAI

    		
  

  

    
      
         LocalAGI Logo
         
LocalAGI

      
    		
    
      
A powerful Local AI agent management platform. Serves as a drop-in replacement for OpenAI's Responses API, supercharged with advanced agentic capabilities and a no-code UI.

      
Link: https://github.com/mudler/LocalAGI

    		
  

  

    
      
         LocalRecall Logo
         
LocalRecall

      
    		
    
      
A RESTful API and knowledge base management system providing persistent memory and storage capabilities for AI agents. Designed to work alongside LocalAI and LocalAGI.

      
Link: https://github.com/mudler/LocalRecall

    		
  




Join the Movement! ❤️


A massive THANK YOU to our incredible community and our sponsors! LocalAI has over 33,500 stars, and LocalAGI has already rocketed past 800+ stars!


As a reminder, LocalAI is real FOSS (Free and Open Source Software) and its sibling projects are community-driven and not backed by VCs or a company. We rely on contributors donating their spare time and our sponsors to provide us the hardware! If you love open-source, privacy-first AI, please consider starring the repos, contributing code, reporting bugs, or spreading the word!


👉 Check out the reborn LocalAGI v2 today: https://github.com/mudler/LocalAGI


Full changelog :point_down:




:point_right: Click to expand :point_left: 


What's Changed


Breaking Changes 🛠



Bug fixes :bug:



Exciting New Features 🎉



🧠 Models



👒 Dependencies



Other Changes





Full Changelog: mudler/LocalAI@v3.0.0...v3.1.0

View the full release notes at https://github.com/mudler/LocalAI/releases/tag/v3.1.0.

@github-actions github-actions bot added go Go use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Jun 26, 2025
@p-linnane
Copy link
Member

p-linnane commented Jun 27, 2025

@Homebrew/core Upstream has this resource pinned to 1.71.0. Do we want to downgrade to that, or try to upgrade to the latest release (1.73.1)?

@p-linnane p-linnane added the maintainer feedback Additional maintainers' opinions may be needed label Jun 27, 2025
@chenrui333
Copy link
Member

chenrui333 commented Jun 27, 2025

yeah, I think we can bump the upstream and here to the latest if it does not break anything.

@chenrui333
Copy link
Member

chenrui333 commented Jun 28, 2025

close in favor of #228402 (we just merged it)

@chenrui333 chenrui333 closed this Jun 28, 2025
@chenrui333 chenrui333 deleted the bump-localai-3.1.0 branch June 28, 2025 02:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

bump-formula-pr PR was created using `brew bump-formula-pr` go Go use is a significant feature of the PR or issue maintainer feedback Additional maintainers' opinions may be needed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@BrewTestBot @p-linnane @chenrui333