Skip to content

Bump github-app-mcp image to 1.0.3 - #2096

Merged
Avi-Robusta merged 1 commit into
masterfrom
bump-github-app-mcp-1.0.3
May 27, 2026
Merged

Avi-Robusta merged 1 commit into
masterfrom
bump-github-app-mcp-1.0.3

Conversation

@Avi-Robusta

@Avi-Robusta Avi-Robusta commented May 27, 2026

Copy link
Copy Markdown
Collaborator

Summary by CodeRabbit

  • Updates
    • Updated GitHub MCP addon to the latest version.

Review Change Stack

Signed-off-by: avi@robusta.dev <avi@robusta.dev>

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This repository is configured for manual code reviews. Comment @claude review to trigger a review and subscribe this PR to future pushes, or @claude review once for a one-time review.

Tip: disable this comment in your organization's Code Review settings.

@coderabbitai

coderabbitai Bot commented May 27, 2026

Copy link
Copy Markdown
Contributor

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 6370a3c5-8951-43ac-8ce6-4fe581dc652a

📥 Commits

Reviewing files that changed from the base of the PR and between 0944fba and 8578951.

📒 Files selected for processing (1)
  • helm/holmes/values.yaml

Walkthrough

The Helm values.yaml file updates the GitHub MCP addon's image tag from version 1.0.2 to 1.0.3 in the mcpAddons.github.githubApp configuration.

Changes

GitHub App MCP Version Update

Layer / File(s) Summary
GitHub App MCP image tag version bump
helm/holmes/values.yaml
Updates the GitHub App MCP addon image tag from github-app-mcp:1.0.2 to github-app-mcp:1.0.3.

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

Possibly related PRs

Suggested reviewers

  • arikalon1
  • RoiGlinik
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The pull request title accurately describes the main change: bumping the github-app-mcp image version from 1.0.2 to 1.0.3, which matches the file modification in helm/holmes/values.yaml.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions

github-actions Bot commented May 27, 2026

Copy link
Copy Markdown
Contributor

✅ Results of HolmesGPT evals

Automatically triggered by commit 8578951 on branch bump-github-app-mcp-1.0.3

View workflow logs

Results of HolmesGPT evals

  • ask_holmes: 11/11 test cases were successful, 0 regressions
Status Test case Time Turns Tools Cost Total tokens Input Max input Output Max output Cached Non-cached Reasoning Compactions Src
09_crashpod 42.6s 6 11 $0.2984 128,658 126,115 24,238 2,543 872 100,710 25,405 389 src
101_loki_historical_logs_pod_deleted 83.8s 8 22 $0.4720 207,450 202,312 31,336 5,138 927 166,690 35,622 787 src
112_find_pvcs_by_uuid 20.5s 3 4 $0.2035 61,003 59,865 21,815 1,138 603 37,793 22,072 241 src
12_job_crashing 46.6s 6 16 $0.3237 137,477 134,590 26,140 2,887 743 107,456 27,134 176 src
176_network_policy_blocking_traffic_no_skills 48.6s 5 13 $0.3132 115,197 112,273 26,318 2,924 851 85,031 27,242 526 src
227_count_configmaps_per_namespace[0] 21.5s 4 9 $0.2077 76,676 75,548 20,647 1,128 594 53,977 21,571 53 src
243_pod_names_contain_service 46.8s 6 13 $0.3054 129,730 126,938 24,231 2,792 738 101,577 25,361 385 src
24_misconfigured_pvc 43.5s 5 13 $0.2903 108,111 105,428 24,092 2,683 958 80,092 25,336 304 src
43_current_datetime_from_prompt 4.8s 1 $0.1189 16,999 16,899 16,899 100 100 0 16,899 60 src
51_logs_summarize_errors 21.9s 4 5 $0.2017 76,728 75,677 20,739 1,051 397 54,933 20,744 32 src
61_exact_match_counting 11.6s 3 3 $0.1518 52,721 52,359 17,873 362 215 34,482 17,877 31 src
Total 35.6s avg 4.6 avg 10.9 avg $2.8867 1,110,750 1,088,004 31,336 22,746 958 822,741 265,263 2,984
Benchmark Comparison Details

Master baseline: latest master-* experiment (post-merge regression eval)
Status: 10 test/model combinations loaded

Benchmark baseline: latest ci-benchmark experiment on master
Status: 187 test/model combinations loaded

Time comparison (seconds):

Test case This branch master (21h ago) Δ vs master benchmark (2d ago) Δ vs benchmark
09_crashpod (opus-4.6) 📄 42.6s 37.7s ↑13% 37.6s ↑13%
101_loki_historical_logs_pod_deleted (opus-4.6) 📄 83.8s 95.9s ↓13% 73.0s ↑15%
112_find_pvcs_by_uuid (opus-4.6) 📄 20.5s 19.2s ±0% 20.9s ±0%
12_job_crashing (opus-4.6) 📄 46.6s 45.3s ±0%
176_network_policy_blocking_traffic_no_skills (opus-4.6) 📄 48.6s 50.1s ±0% 45.8s ±0%
227_count_configmaps_per_namespace[0] (opus-4.6) 📄 21.5s 19.7s ±0% 20.0s ±0%
243_pod_names_contain_service (opus-4.6) 📄 46.8s 33.9s ↑38% 41.1s ↑14%
24_misconfigured_pvc (opus-4.6) 📄 43.5s 39.3s ↑11% 38.4s ↑13%
43_current_datetime_from_prompt (opus-4.6) 📄 4.8s 3.3s ↑47% 3.5s ↑36%
51_logs_summarize_errors (opus-4.6) 📄 21.9s 21.7s ±0% 22.3s ±0%
61_exact_match_counting (opus-4.6) 📄 11.6s 11.9s ±0% 10.3s ↑12%
Total (all, n=11) 35.6s 33.3s 32.6s
Comparable (m=10, b=11) 34.5s 33.3s ±0% 32.6s ±0%

Cost comparison:

Test case This branch master (21h ago) Δ vs master benchmark (2d ago) Δ vs benchmark
09_crashpod (opus-4.6) 📄 $0.2984 $0.2762 ±0% $0.2799 ±0%
101_loki_historical_logs_pod_deleted (opus-4.6) 📄 $0.4720 $0.4728 ±0% $0.4212 ↑12%
112_find_pvcs_by_uuid (opus-4.6) 📄 $0.2035 $0.2024 ±0% $0.2055 ±0%
12_job_crashing (opus-4.6) 📄 $0.3237 $0.3155 ±0%
176_network_policy_blocking_traffic_no_skills (opus-4.6) 📄 $0.3132 $0.3359 ±0% $0.3301 ±0%
227_count_configmaps_per_namespace[0] (opus-4.6) 📄 $0.2077 $0.2031 ±0% $0.2055 ±0%
243_pod_names_contain_service (opus-4.6) 📄 $0.3054 $0.2548 ↑20% $0.2887 ±0%
24_misconfigured_pvc (opus-4.6) 📄 $0.2903 $0.2981 ±0% $0.2854 ±0%
43_current_datetime_from_prompt (opus-4.6) 📄 $0.1189 $0.1190 ±0% $0.1182 ±0%
51_logs_summarize_errors (opus-4.6) 📄 $0.2017 $0.2016 ±0% $0.2052 ±0%
61_exact_match_counting (opus-4.6) 📄 $0.1518 $0.1518 ±0% $0.1511 ±0%
Total (all, n=11) $0.2624 $0.2516 $0.2551
Comparable (m=10, b=11) $0.2563 $0.2516 ±0% $0.2551 ±0%

Total tokens comparison:

Test case This branch master (21h ago) Δ vs master benchmark (2d ago) Δ vs benchmark
09_crashpod (opus-4.6) 📄 128,658 107,440 ↑20% 106,269 ↑21%
101_loki_historical_logs_pod_deleted (opus-4.6) 📄 207,450 206,821 ±0% 171,838 ↑21%
112_find_pvcs_by_uuid (opus-4.6) 📄 61,003 60,894 ±0% 60,885 ±0%
12_job_crashing (opus-4.6) 📄 137,477 134,896 ±0%
176_network_policy_blocking_traffic_no_skills (opus-4.6) 📄 115,197 116,671 ±0% 138,789 ↓17%
227_count_configmaps_per_namespace[0] (opus-4.6) 📄 76,676 76,665 ±0% 76,302 ±0%
243_pod_names_contain_service (opus-4.6) 📄 129,730 102,035 ↑27% 126,664 ±0%
24_misconfigured_pvc (opus-4.6) 📄 108,111 113,685 ±0% 107,150 ±0%
43_current_datetime_from_prompt (opus-4.6) 📄 16,999 17,001 ±0% 16,898 ±0%
51_logs_summarize_errors (opus-4.6) 📄 76,728 76,699 ±0% 77,029 ±0%
61_exact_match_counting (opus-4.6) 📄 52,721 52,728 ±0% 52,431 ±0%
Total (all, n=11) 100,977 93,064 97,196
Comparable (m=10, b=11) 97,327 93,064 ±0% 97,196 ±0%

Cached tokens comparison:

Test case This branch master (21h ago) Δ vs master benchmark (2d ago) Δ vs benchmark
09_crashpod (opus-4.6) 📄 100,710 80,592 ↑25% 78,682 ↑28%
101_loki_historical_logs_pod_deleted (opus-4.6) 📄 166,690 167,635 ±0% 134,429 ↑24%
112_find_pvcs_by_uuid (opus-4.6) 📄 37,793 37,763 ±0% 37,612 ±0%
12_job_crashing (opus-4.6) 📄 107,456 105,026 ±0%
176_network_policy_blocking_traffic_no_skills (opus-4.6) 📄 85,031 83,928 ±0% 108,400 ↓22%
227_count_configmaps_per_namespace[0] (opus-4.6) 📄 53,977 54,892 ±0% 53,987 ±0%
243_pod_names_contain_service (opus-4.6) 📄 101,577 76,705 ↑32% 100,135 ±0%
24_misconfigured_pvc (opus-4.6) 📄 80,092 84,091 ±0% 79,251 ±0%
43_current_datetime_from_prompt (opus-4.6) 📄
51_logs_summarize_errors (opus-4.6) 📄 54,933 54,923 ±0% 54,949 ±0%
61_exact_match_counting (opus-4.6) 📄 34,482 34,485 ±0% 34,287 ±0%
Total (all, n=11) 74,795 67,501 71,523
Comparable (m=9, b=10) 79,476 75,002 ±0% 78,676 ±0%

Turns comparison:

Test case This branch master (21h ago) Δ vs master benchmark (2d ago) Δ vs benchmark
09_crashpod (opus-4.6) 📄 6 5 ↑20% 5 ↑20%
101_loki_historical_logs_pod_deleted (opus-4.6) 📄 8 8 ±0% 7 ↑14%
112_find_pvcs_by_uuid (opus-4.6) 📄 3 3 ±0% 3 ±0%
12_job_crashing (opus-4.6) 📄 6 6 ±0%
176_network_policy_blocking_traffic_no_skills (opus-4.6) 📄 5 5 ±0% 6 ↓17%
227_count_configmaps_per_namespace[0] (opus-4.6) 📄 4 4 ±0% 4 ±0%
243_pod_names_contain_service (opus-4.6) 📄 6 5 ↑20% 6 ±0%
24_misconfigured_pvc (opus-4.6) 📄 5 5 ±0% 5 ±0%
43_current_datetime_from_prompt (opus-4.6) 📄 1 1 ±0% 1 ±0%
51_logs_summarize_errors (opus-4.6) 📄 4 4 ±0% 4 ±0%
61_exact_match_counting (opus-4.6) 📄 3 3 ±0% 3 ±0%
Total (all, n=11) 4.6 4.3 4.5
Comparable (m=10, b=11) 4.5 4.3 ±0% 4.5 ±0%

Tool calls comparison:

Test case This branch master (21h ago) Δ vs master benchmark (2d ago) Δ vs benchmark
09_crashpod (opus-4.6) 📄 11 11 ±0% 11 ±0%
101_loki_historical_logs_pod_deleted (opus-4.6) 📄 22 19 ↑16% 17 ↑29%
112_find_pvcs_by_uuid (opus-4.6) 📄 4 4 ±0% 4 ±0%
12_job_crashing (opus-4.6) 📄 16 14 ↑14%
176_network_policy_blocking_traffic_no_skills (opus-4.6) 📄 13 15 ↓13% 15 ↓13%
227_count_configmaps_per_namespace[0] (opus-4.6) 📄 9 9 ±0% 9 ±0%
243_pod_names_contain_service (opus-4.6) 📄 13 9 ↑44% 11 ↑18%
24_misconfigured_pvc (opus-4.6) 📄 13 13 ±0% 14 ±0%
43_current_datetime_from_prompt (opus-4.6) 📄
51_logs_summarize_errors (opus-4.6) 📄 5 5 ±0% 5 ±0%
61_exact_match_counting (opus-4.6) 📄 3 3 ±0% 3 ±0%
Total (all, n=11) 9.9 9.8 10.3
Comparable (m=9, b=10) 10.3 9.8 ±0% 10.3 ±0%

Comparison indicators:

  • ±0% — diff under 10% (within noise threshold)
  • ↑N%/↓N% — diff 10-25%
  • ↑N%/↓N% — diff over 25% (significant)
📖 Legend
Icon Meaning
The test was successful
The test was skipped
⚠️ The test failed but is known to be flaky or known to fail
🚧 The test had a setup failure (not a code regression)
🔧 The test failed due to mock data issues (not a code regression)
🚫 The test was throttled by API rate limits/overload
The test failed and should be fixed before merging the PR
🔄 Re-run evals manually

⚠️ Warning: /eval comments always run using the workflow from master, not from this PR branch. If you modified the GitHub Action (e.g., added secrets or env vars), those changes won't take effect.

To test workflow changes, use the GitHub CLI or Actions UI instead:

gh workflow run eval-regression.yaml --repo HolmesGPT/holmesgpt --ref bump-github-app-mcp-1.0.3 -f markers=regression -f filter=

Option 1: Comment on this PR with /eval:

/eval
tags: regression

Or with more options (one per line):

/eval
model: gpt-4o
tags: regression
id: 09_crashpod
iterations: 5

Run evals on a different branch (e.g., master) for comparison:

/eval
branch: master
tags: regression
Option Description
model Model(s) to test (default: same as automatic runs)
tags Pytest tags / markers (no default - runs all tests!)
id Eval ID / pytest -k filter (use /list to see valid eval names)
iterations Number of runs, max 10
branch Run evals on a different branch (for cross-branch comparison)

Quick re-run: Use /rerun to re-run the most recent /eval on this PR with the same parameters.

Option 2: Trigger via GitHub Actions UI → "Run workflow"

Option 3: Add PR labels to include extra evals (applies to both automatic runs and /eval comments):

Label Effect
evals-tag-<name> Run tests with tag <name> alongside regression
evals-id-<name> Run a specific eval by test ID
evals-model-<name> Override the model (use model list name, e.g. sonnet-4.5)

Examples: evals-tag-easy, evals-id-09_crashpod, evals-model-sonnet-4.5

🏷️ Valid tags

benchmark, chain-of-causation, compaction, confluence, context_window, conversation_worker, coralogix, counting, database, datadog, datetime, db-connectors, easy, elasticsearch, embeds, fast, frontend, grafana, hard, images, integration, kafka, kubernetes, leaked-information, logs, loki, manual, mcp, medium, metrics, network, newrelic, no-cicd, numerical, one-test, port-forward, prometheus, question-answer, regression, skills, slackbot, storage, token-limit, toolset-limitation, traces, transparency, victorialogs

🤖 Valid models

deepseek-chat, deepseek-r1-reasoner, deepseek-reasoner, deepseek-v3.2-chat, gemini-3-flash-preview, gemini-3-pro-preview, gemini-3.1-pro-preview, gpt-4.1, gpt-5.2-high-reasoning, gpt-5.3-codex, gpt-5.4, haiku-4.5, kimi-2.5, kimi-2.5-openrouter, opus-4.5, opus-4.6, opus-4.7, qwen-next-80B-instruct, qwen-next-80B-thinking, sonnet-4.5, sonnet-4.6


Commands: /eval · /rerun · /list

CLI: gh workflow run eval-regression.yaml --repo HolmesGPT/holmesgpt --ref bump-github-app-mcp-1.0.3 -f markers=regression -f filter=

@github-actions

github-actions Bot commented May 27, 2026

Copy link
Copy Markdown
Contributor

Docker images ready for 5cc0c79a (built in 4m 54s)

⚠️ Warning: does not support ARM (ARM images are built on release only - not on every PR)

Use these tags to pull the images for testing.

📋 Copy commands

⚠️ Temporary images are deleted after 30 days. Copy to a permanent registry before using them:

gcloud auth configure-docker us-central1-docker.pkg.dev
docker pull us-central1-docker.pkg.dev/robusta-development/temporary-builds/holmes:5cc0c79a
docker tag us-central1-docker.pkg.dev/robusta-development/temporary-builds/holmes:5cc0c79a me-west1-docker.pkg.dev/robusta-development/development/holmes-dev:5cc0c79a
docker push me-west1-docker.pkg.dev/robusta-development/development/holmes-dev:5cc0c79a
docker pull us-central1-docker.pkg.dev/robusta-development/temporary-builds/holmes-operator:5cc0c79a
docker tag us-central1-docker.pkg.dev/robusta-development/temporary-builds/holmes-operator:5cc0c79a me-west1-docker.pkg.dev/robusta-development/development/holmes-operator-dev:5cc0c79a
docker push me-west1-docker.pkg.dev/robusta-development/development/holmes-operator-dev:5cc0c79a

Patch Helm values in one line (choose the chart you use):

HolmesGPT chart:

helm upgrade --install holmesgpt ./helm/holmes \
  --set registry=me-west1-docker.pkg.dev/robusta-development/development \
  --set image=holmes-dev:5cc0c79a \
  --set operator.registry=me-west1-docker.pkg.dev/robusta-development/development \
  --set operator.image=holmes-operator-dev:5cc0c79a

Robusta wrapper chart:

helm upgrade --install robusta robusta/robusta \
  --reuse-values \
  --set holmes.registry=me-west1-docker.pkg.dev/robusta-development/development \
  --set holmes.image=holmes-dev:5cc0c79a \
  --set holmes.operator.registry=me-west1-docker.pkg.dev/robusta-development/development \
  --set holmes.operator.image=holmes-operator-dev:5cc0c79a

@netlify

netlify Bot commented May 27, 2026

Copy link
Copy Markdown

Deploy Preview for holmes-docs ready!

Name Link
🔨 Latest commit 8578951
🔍 Latest deploy log https://app.netlify.com/projects/holmes-docs/deploys/6a168804c504ea0008b58590
😎 Deploy Preview https://deploy-preview-2096--holmes-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@Avi-Robusta
Avi-Robusta enabled auto-merge (squash) May 27, 2026 06:02
@Avi-Robusta
Avi-Robusta merged commit 959515a into master May 27, 2026
18 of 19 checks passed
@Avi-Robusta
Avi-Robusta deleted the bump-github-app-mcp-1.0.3 branch May 27, 2026 06:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants