Skip to content

fix(agent): optimise headroom and litellm caching #387

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
yxtay merged 4 commits into from
Jul 30, 2026
Merged

fix(agent): optimise headroom and litellm caching #387

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
4cf997b
fix: headroom
yxtay Jul 30, 2026
e9f0602
Update compose.yaml
yxtay Jul 30, 2026
d4cdec8
Update config.yaml
yxtay Jul 30, 2026
0ea5e01
Update compose.yaml
yxtay Jul 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions agent/compose.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -188,11 +188,11 @@ services:
image: ghcr.io/headroomlabs-ai/headroom:0.33.0-code@sha256:f450aa2de66ead24e65223ac8763efca2b87725b04e4ac8fd21a4d05af775099
environment:
HEADROOM_COMPRESS_ALLOW_REMOTE: 1
HEADROOM_LOSSLESS: 1
HEADROOM_NO_CCR: 1
HEADROOM_OUTPUT_SHAPER: 1
HEADROOM_SAVINGS_PROFILE: general
HEADROOM_SAVINGS_PROFILE: coding
HEADROOM_SKIP_UPSTREAM_CHECK: 1
HOME: /home/nonroot/.headroom
XDG_CACHE_HOME: /home/nonroot/.headroom/.cache
cap_drop:
- ALL
security_opt:
Expand Down
5 changes: 5 additions & 0 deletions agent/litellm/config.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,11 +1,16 @@
general_settings:
store_model_in_db: true
cancel_on_disconnect: true
user_api_key_cache_ttl: 300

litellm_settings:
json_logs: true
request_timeout: 60
drop_params: true
cache: true
cache_params:
type: local
ttl: 3600

router_settings:
cooldown_time: 60
Expand Down
Loading