2.3.9 Satellite: cmdh

cmdh

Handle: cmdh URL: -

Starting

cmdh is a CLI-only service that tries to generate a bash command from your input. Be advised that it works best with larger models. Expect acceptable results from codestral and above.

Note

Harbor runs patched version of cmdh that uses Ollama json format and has a slightly tweaked system prompt.

Harbor mounts $PWD to the service, so it can work with it directly. The $PWD will match those of a host, but be aware that only the child directories are actually available.

# Go where you'd run the command
# "z" is from pazi-jump
z cache
cd ~/.cache/huggingface

harbor cmdh 'find all the ggufs here'

user@os:~/.cache/huggingface$ ▼ harbor cmdh 'find all the ggufs here'
✔ Retrieving command... find all the ggufs here
desired command: find / -type f -name "*.gguf"
assistant message: The 'find' command is a powerful utility that searches for files and directories in a specified path. In this case, it will search the entire file system from root (/) for any files with the extension '.gguf'. The options used ensure that only regular files are considered, not directories or other types of files.
? Choose an option: Run desired command
Running: find / -type f -name "*.gguf"
/home/everlier/.cache/huggingface/gguf/llama3-simpo-expo-q8_0.gguf
/home/everlier/.cache/huggingface/gguf/llama3-simpo-expo-q2_k.gguf
/home/everlier/.cache/huggingface/gguf/llama3-simpo-expo-q4_k.gguf
/home/everlier/.cache/huggingface/gguf/phi-3-mini-128k-instruct.Q4_K_M.gguf
/home/everlier/.cache/huggingface/Tess-v2.5-Phi-3-medium-128k-14B-Q6_K.gguf

Configuration

Ollama

You should select a model for the cmdh to use.

# Set cmdh to use ollama (if not already set)
harbor cmdh host ollama

# See what's currently available
harbor ollama list

# See currently configured model
harbor cmdh model

# Set the model to run
harbor cmdh model codestral

OpenAI

cmdh should also work with OpenAI-compatible APIs.

# Note the casing - required by library
harbor cmdh host OpenAI

# Point cmdh to OpenAI API
harbor cmdh key <key>
harbor cmdh url <url>

# Set the model to run
harbor cmdh model gpt-3.5-turbo