Provider error proxy for simulating various types of errors #5091

katzdave · 2025-10-09T15:11:07Z

Still in flight as I encounter issues + test more providers but already starting to be useful in uncovering some issues of errors we handle poorly.

Providers to test:

* 'main' of github.com:block/goose: (49 commits) fixing video embed (#5171) chore: clean up random unused files (#5166) fix: adjust download_cli.sh to tolerate no OS variable (#5169) mcp tutorial page for firecrawl (#5152) Remove orphaned tool calls before compaction (#5059) feat: add copy as markdown button to documentation pages (#5158) chore: include vendored node executable (#5160) remove extra whitespace from message (#5159) Clear deeplinks after use (#5128) Revert "Fix gpt-5 input context limit (#4619)" (#5135) fix: missing cmake and protobuf for windows build, deduplicate sh/pws… (#5028) Fix bedrock tool input schema (#5064) Add self-test recipe for goose validation (#5111) fix: modifies openai request logic for reasoning models (#4221) (#4294) Fix race condition threat when set_param and set_secret of c… (#5109) Clean room implementation of the chat process (#5079) Bump rmcp (#5096) set version in an env variable for testing (#5100) fix : enhance fuzzy file search in goose desktop (#5071) Make async (#5126) ...

* 'main' of github.com:block/goose: Declarative providers (#5084) adding youtube link to firecrawl mcp tutorial, merge after 9am Eastern Oct 15 (#5173) Ollama integration: modified default model + added models (#5153) Fix codex subagent configuration in documentation (#5180) fix: include apple silicon build of the desktop app in build artifacts (#5174)

DOsinga · 2025-10-15T20:36:32Z

scripts/provider-error-proxy/pyproject.toml

@@ -0,0 +1,9 @@
+[project]


for a one file python thing, you can just add the dependencies to to main file

michaelneale · 2025-10-27T00:13:53Z

great idea - I think anthropic is really needed as it seems to have the most issues (and is one of the more popular 1st party ones).

* 'main' of github.com:block/goose: (132 commits) Fix/icon ii (#5413) Enable runtime access to provider name (#5399) fix: ensure trailing newline in files created by `text_editor` tool (#5336) docs: September 2025 Community All-Stars (#5411) make supports_cache_control async to avoid block in place (#5362) Send all the logs we output (#5363) Recipe variables (#5365) Feat/add mermaid chart rendering (#5377) Set up Datadog metrics for prompt injection detection (#5385) fix: restore --resume functionality for most recent session (#5401) Gemini again (#5390) docs(prompt-library): add github-issue-labeler intermediate prompt (#5374) docs: add Linux and Windows paths to uninstall section (#5371) fix: --session-id shouldn't work without --resume, but --name should (#5360) Auto-compact Threshold UI improvements (#5354) Filter preserved user messages to be text only. (#5391) include sessionId in tool request (#5394) feat: add PR Impact Analyzer prompt (#5375) docs: add blog post on configuring goose for team environments (#5380) migrating back with new chatrecall non underscore name (#5223) ...

* 'main' of github.com:block/goose: (61 commits) [Autovisualiser] remove unnecessary content from mermaid HTML template (#5505) Improve subagents docs (#5484) FIX: prefer linux in WSL and add INSTALL_OS override for CLI (#5215) Propagate session ID in LLM and MCP requests (#5165) feat: YT Short for Canva MCP + goose (#5495) Change Recipes Test Script (#5457) Goose recover (#5450) don't start the default provider (#5351) keep the order of keys in config.yaml (#5468) Removed drafts and agentIsReady in ChatInput (#5366) nextcamp - fix session resume when navigating back to chat in sidebar (#5370) feat/fix: set optional config params, and don't overwrite unset secrets (#5325) Stringly typed config (#5463) Fix: Compaction client <-> server sync (#5481) docs: recipe activity parameter substitution (#5462) only run fork on branch PRs (#5461) docs: video on goose with apify mcp (#5472) Clear windows and fix build failure (#5452) Add menu option for setting window always on top (#5429) Delete environment variable (#5479) ...

Copilot

Pull Request Overview

This PR adds a new Python-based HTTP proxy tool for simulating provider errors during testing of Goose's error handling and retry logic. The proxy intercepts traffic to AI providers (OpenAI, Anthropic, Google, OpenRouter, Tetrate, Databricks) and allows interactive error injection via stdin commands.

Key changes:

New Python-based HTTP proxy with interactive error injection capabilities
Supports multiple error types (context length exceeded, rate limits, server errors) with configurable injection patterns (count-based, percentage-based)
Handles both regular HTTP responses and streaming responses (SSE) transparently

Reviewed Changes

Copilot reviewed 3 out of 4 changed files in this pull request and generated 2 comments.

File	Description
scripts/provider-error-proxy/proxy.py	Main proxy implementation with request handling, provider detection, error injection logic, and streaming support
scripts/provider-error-proxy/pyproject.toml	Python project configuration with dependencies (aiohttp, brotli)
scripts/provider-error-proxy/uv.lock	Dependency lock file generated by uv package manager
scripts/provider-error-proxy/README.md	Comprehensive documentation covering features, usage, configuration, and error types per provider

Comments suppressed due to low confidence (1)

scripts/provider-error-proxy/proxy.py:30

Import of 'sys' is not used.

import sys

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2025-11-03T21:27:30Z

scripts/provider-error-proxy/proxy.py

+import asyncio
+import logging
+import os
+import sys


The 'sys' import is unused and should be removed to keep imports clean.

Suggested change

import sys

Copilot · 2025-11-03T21:27:31Z

scripts/provider-error-proxy/proxy.py

+        Returns:
+            True if an error should be injected, False otherwise
+        """
+        import random


The 'random' import should be moved to the top of the file with other imports, following Python's standard import organization (standard library, third-party, local).

* 'main' of github.com:block/goose: (21 commits) Manual compaction counting fix + cli cleanup (#5480) chore(deps): bump prismjs and react-syntax-highlighter in /ui/desktop (#5549) fix: remove qwen3-coder from provider/mcp smoke tests (#5551) fix: do not build unsigned desktop app bundles on every PR in ci. add manual option. (#5550) fix: update Husky prepare script to v9 format (#5522) Fix 404 for responsible coding guide (#5543) fix hermit `text file busy` issues on linux (#5372) Fix image processing (#5544) docs: AI attribution for PRs (#5547) chore(tests/mcp): testing for MCP sampling (#5456) docs: adding HOWTOAI.md (#5533) added configuration content, also added signoff, fix merging issue with another commit by creating a clean branch. removed and closed commits that caused signoff issues. (#5519) Fixes Gemini API parse issue by converting nullable type arrays to single types in tool schemas (#5530) Troubleshooting diagnostics doc (#5526) fix link to Ollama FAQ (#5531) docs: remove speech-mcp (#5514) fix: adds ProviderRetry to openai provider (#5518) docs: extensions directory minor updates (#5466) Docs/json recipe support (#5492) docs: recipe buttons (#5507) ...

* 'main' of github.com:block/goose: Sessions required (#5548) feat: add grouped extension loading notification (#5529) we should run this on main and also test open models at least via ope… (#5556) info: print location of sessions.db via goose info (#5557) chore: remove yarn usage from documentation (#5555) cli: adjust default theme to address #1905 (#5552)

DOsinga · 2025-11-06T21:07:21Z

have a look at what copilot said and let's merge this?

* 'main' of github.com:block/goose: (125 commits) Document Mistral AI provider (#5799) docs: Add Community Stars recipe script and txt file (#5776) chore: incorporate LF feedback (#5787) docs: quick launcher (#5779) Bump auto scroll threshold (#5738) fix: add one-time cleanup for linux hermit locking issues (#5742) Don't show update tray icon if GOOSE_VERSION is set (#5750) fix: get win node path from registry (#5731) Handle spaces in extension names also (#5770) Remove empty settings card for Scheduling Engine (#5771) fix windows cli build (#5768) fix: Implement a CredentialStore for auth (#5741) blog post: How to Successfully Migrate Your App with an AI Agent (#5762) Simplify finding `goosed` (#5739) More time for goosed (#5746) Match lower case (#5763) scan recipe for security when saving recipe (#5747) feat: trying grok for live test (#5732) Platform Extension MOIM (Minus One Info Message) (#5027) docs: remove hackathon banner (#5756) ...

Copilot

Pull Request Overview

Copilot reviewed 3 out of 4 changed files in this pull request and generated no new comments.

* main: feat/fix Re-enabled WAL with commit transaction management (Linux Verification Requested) (#5793) chore: remove autopilot experimental feature (#5781) Read paths from an interactive & login shell (#5774) docs: acp clients (#5800) Provider error proxy for simulating various types of errors (#5091) chore: Add links to maintainer profiles (#5788) Quick fix for community all stars script (#5798) Document Mistral AI provider (#5799) docs: Add Community Stars recipe script and txt file (#5776)

* main: (33 commits) fix: support Gemini 3's thought signatures (#5806) chore: Add Adrian Cole to Maintainers (#5815) [MCP-UI] Proxy and Better Message Handling (#5487) Release 1.15.0 Document New Window menu in macOS dock (#5811) Catch cron errors (#5707) feat/fix Re-enabled WAL with commit transaction management (Linux Verification Requested) (#5793) chore: remove autopilot experimental feature (#5781) Read paths from an interactive & login shell (#5774) docs: acp clients (#5800) Provider error proxy for simulating various types of errors (#5091) chore: Add links to maintainer profiles (#5788) Quick fix for community all stars script (#5798) Document Mistral AI provider (#5799) docs: Add Community Stars recipe script and txt file (#5776) chore: incorporate LF feedback (#5787) docs: quick launcher (#5779) Bump auto scroll threshold (#5738) fix: add one-time cleanup for linux hermit locking issues (#5742) Don't show update tray icon if GOOSE_VERSION is set (#5750) ...

Signed-off-by: Blair Allan <[email protected]>

katzdave added 9 commits October 9, 2025 00:29

proxy works

5d95472

proxy working, now having session description issues

4ec2d98

cleanup docs

df2ba9e

Error count

708f6d6

new interface

9419ada

no testS

9c79b39

improve status display

cb0bc1c

DOsinga reviewed Oct 15, 2025

View reviewed changes

DOsinga approved these changes Oct 15, 2025

View reviewed changes

fix error

c27ac89

katzdave added 4 commits October 28, 2025 15:12

Fix google host

634b9b1

works with databricks

aef68ee

katzdave marked this pull request as ready for review November 3, 2025 21:25

Copilot AI review requested due to automatic review settings November 3, 2025 21:25

Copilot AI reviewed Nov 3, 2025

View reviewed changes

katzdave added 2 commits November 3, 2025 16:43

katzdave added 3 commits November 18, 2025 15:18

Copilot import fixes

10788e3

Rm noise

6e5e24d

Copilot AI review requested due to automatic review settings November 18, 2025 20:20

Copilot started reviewing on behalf of katzdave November 18, 2025 20:22 View session

Copilot finished reviewing on behalf of katzdave November 18, 2025 20:22

Copilot AI reviewed Nov 18, 2025

View reviewed changes

katzdave merged commit 1d8d6a1 into main Nov 18, 2025
38 of 43 checks passed

github-actions bot mentioned this pull request Nov 25, 2025

chore(release): release version 1.16.0 (minor) #5867

Closed

BlairAllan pushed a commit to BlairAllan/goose that referenced this pull request Nov 29, 2025

Provider error proxy for simulating various types of errors (block#5091)

1099f6a

Signed-off-by: Blair Allan <[email protected]>

github-actions bot mentioned this pull request Dec 4, 2025

chore(release): release version 1.16.0 (minor) #5985

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Provider error proxy for simulating various types of errors #5091

Provider error proxy for simulating various types of errors #5091

Uh oh!

katzdave commented Oct 9, 2025 •

edited

Loading

Uh oh!

DOsinga Oct 15, 2025

Uh oh!

michaelneale commented Oct 27, 2025

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Nov 3, 2025

Uh oh!

Copilot AI Nov 3, 2025

Uh oh!

DOsinga commented Nov 6, 2025

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Provider error proxy for simulating various types of errors #5091

Provider error proxy for simulating various types of errors #5091

Uh oh!

Conversation

katzdave commented Oct 9, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

DOsinga Oct 15, 2025

Choose a reason for hiding this comment

Uh oh!

michaelneale commented Oct 27, 2025

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Copilot AI Nov 3, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Nov 3, 2025

Choose a reason for hiding this comment

Uh oh!

DOsinga commented Nov 6, 2025

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

katzdave commented Oct 9, 2025 •

edited

Loading