v0.2.22 - KoboldCpp

KoboldCpp

# [Optional] per-pull the image
harbor pull kobold

# Will take a while on the first run
harbor up kobold

KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. Out of the box, Harbor will pre-connect kobold to Open WebUI.

Misc

• Fix Webtop container's connection to Harbor and Docker Socket by @SimonBlancoE in #98
• More portable shebang for the CLI
• harbor doctor - tests all requirements before exiting, more granular requirements for docker, Nvidia
• MCTS was updated to become compatible with OWUI v0.5.4 (most recent as of today)
• We now have a ko-fi page

New Contributors 🎉

• @SimonBlancoE made their first contribution in #98

Full Changelog: v0.2.21...v0.2.22

v0.2.21

v0.2.21

This is a small bugfix release for Dify to avoid using pkgx as it's not really needed there.

Full Changelog: v0.2.20...v0.2.21

v0.2.20 - OptiLLM, Langfuse v3

OptiLLM

optillm is an optimising LLM proxy, similar to Harbor Boost with a lot of advanced reasoning/planning workflows.

# Will build and start the service
# [--tail] is optional to automatically follow service logs after start
harbor up optillm --tail

• Service wiki entry
• Official docs

optillm is connected to all inference backends in Harbor out of the box (but haven't been tested). See compatibility guide on making it work with Open WebUI.

Misc

• langfuse was updated to v3

v0.2.19 - Langflow

LangFlow

Integration authored by @ZacharyKehlGEAppliances 🎉

# Will pull the image and spin up the service
harbor up langflow --open

See the service wiki for more information

Misc

• Harbor App
  • Fixing service metadata
  • App now has links to service wiki pages where applicable
  • Service tags are explained with tooltips
  • Tauri dependencies updated to release v2.0

New Contributors

• @ZacharyKehlGEAppliances made their first contribution in #86

Full Changelog: v0.2.18...v0.2.19

v0.2.18 - Flowise, Bolt

Flowise

Open source low-code tool for developers to build customized LLM orchestration flow & AI agents.

# Will pull images and auto-open the service after start
harbor up flowise --open

Bolt.new

Bolt.new is an AI-powered web development agent that allows you to prompt, run, edit, and deploy full-stack applications directly from your browser.

# Will pull images and auto-open the service after start
harbor up bolt --open

Misc

• Extra services docs
• Docs on env var management and Ollama modelfiles
• Scaffold script for adding new services

Full Changelog: v0.2.17...v0.2.18

v0.2.17 - Desktop agent tools

This release combines a few useful tools for developing the LLMs using computers almost like we do.

Webtop

Courtesy of LinuxServer.io, a service providing a dockerized GUI sandbox to aid with development and tests of desktop LLM agents (👋🏻 computer use). Additionally, provides a mean of accessing Harbor App and Harbor CLI remotely from the instance where they are running (via VNC)

# Will take a while
harbor build webtop
# Start and open
harbor up webtop --open

webtop service will mount Harbor CLI from your host as well as install latest release of Harbor App.

OmniParser

A release from Microsoft, breakthrough tool for annotating GUI for using with autonomous desktop agents.

⚠️ Requires Nvidia+CUDA to run.

# Will take a long while
harbor build omniparser
# Start and open
harbor up omniparser --open

Promptfoo

promptfoo is a CLI tool that allows to develop and evaluate prompts and LLM APIs. It's neatly built and comes with all imaginable ways to configure and evaluate prompts. Harbor's version comes with a couple of examples and is preconfigured to work with built-in ollama

Misc

• Small tweaks to harbor CLI
• Unsuccessful perplexideez integration (blocked by support for running on localhost)
• docs: harbor app README.md updated by @ic4l4s9c in #79

Full Changelog: v0.2.16...v0.2.17

v0.2.16 - 4 new services, bugfixes, Discord

Overview

This release comes a few new services, as well as some additional helper features.

Open WebUI Pipelines

Integration authored by @ic4l4s9c 🎉

pipelines bring modular, customizable workflows to any UI client supporting OpenAI API specs.

harbor up pipelines

• Official documentation
• Examples on GitHub

Qdrant

Also authored by @ic4l4s9c 🎉

First shared vector store for Harbor - will be used by supported satellites in the future.

harbor up qdrant

REST API: http://localhost:34221
Web UI: http://localhost:34221/dashboard
GRPC API: http://localhost:34222

Chat Nio

New promising WebUI for LLMs. Harbor pre-configures it for ollama and searxng out of the box.

# Start the service
harbor up chatnio
# [Optional] Open the UI
harbor open chatnio

K6

Load testing toolkit. Harbor's version comes with a lot of things pre-configured testing of OpenAI-compatible LLM APIs, including a custom grafana dashboard (with token stats), api client helpers and sample scripts.

Discord

We have a Discord now. Come say "Hi 👋🏻" if you want to chat to someone about Harbor.

Misc

• webui - fixing missing override.env after v0.2.15
• harbor open - now supports overrides via <service>.open_url config

New Contributors

• @ic4l4s9c made their first contribution in #75

Full Changelog: v0.2.15...v0.2.16

v0.2.15 - CLI fixes and improvements

harbor env

You can now set service-specific env vars directly via Harbor CLI

# Show the current environment variables for the "n8n" service
harbor env n8n

# Get a specific environment variable
# for the dify service (LOG_LEVEL under the hood)
harbor env dify log.level

# Set a brand new environment variable for the service
# All three are equivalent
harbor env cmdh NODE_ENV development

Misc

• cmdh - fixing service build and init
• n8n - using N8N_SECURE_COOKIE by default, since Harbor is expected to run on localhost
• comfyui - disable web auth by default to provide seamless integration with webui out of the box
• documentation fixes and improvements

v0.2.14

• Relaxing Python version requirement for PyPI installs
• Attempt to explicitly resolve home folder permissions for Harbor App

Full Changelog: v0.2.13...v0.2.14

v0.2.13 - n8n

v0.2.13 - n8n integration

n8n is a low-code workflow automation tool that has good support for LLMs.

# Start the service
harbor up n8n
# [Optional] open in the browser
harbor open n8n

Harbor's integration is mostly around allowing to run and configure n8n as the other Harbor services, as pre-configuring the connections/workflows dynamically is not something that is currently supported.

Please find detailed instructions in the service docs

Misc

• Broken (for now) integration with the Bolt.new, awaiting for the fixes in the upstream

Full Changelog: v0.2.12...v0.2.13