Add agent-eval step registry and ai-helpers eval presubmit - #79925

Merged

openshift-merge-bot[bot] merged 17 commits into

openshift:mainfrom

not-stbenjam:ai-helpers-eval-presubmit

Jun 1, 2026

Commits on Jun 1, 2026

Add agent-eval step registry and ai-helpers eval presubmit

not-stbenjam
and
claude
committed
94b833b
Pin mlflow, error on missing setup script, update owners

not-stbenjam
and
claude
committed
4a3fab5
Add marketplace registration before plugin install

not-stbenjam
and
claude
committed
bbef4aa
Add hello-world smoke test fallback when eval config missing

not-stbenjam
and
claude
committed
c004304
Clear EVAL_SETUP_SCRIPT when falling back to smoke test

not-stbenjam
and
claude
committed
869b467
Use private artifact bucket for eval job

not-stbenjam
and
claude
committed
05e21a9
Remove hidden setting from eval job

not-stbenjam
and
claude
committed
a0b9264
Use python3 -m pip instead of bare pip

not-stbenjam
and
claude
committed
c774acd
make ci-operator-config
not-stbenjam
committed
c43ebde
Run mlflow server via python3 -m mlflow

not-stbenjam
and
claude
committed
378e598
Fix mlflow PATH and SSH host key for plugin install

not-stbenjam
and
claude
committed
8a5ade6
Fix mlflow, SSH, and PATH issues in eval step

not-stbenjam
and
claude
committed
90b0026
Add comment for mlflow version pin, remove pipe on pip install

not-stbenjam
and
claude
committed
1f14e82
Clone eval harness directly, use --plugin-dir

not-stbenjam
and
claude
committed
c4adbda
ci: strip hello-world smoke test, fix integration gaps

not-stbenjam
and
claude
committed
6458632
ci: remove unused EVAL_JUDGE_MODEL env var

not-stbenjam
and
claude
committed
f1bfab9
ci: fix shellcheck SC2155 — declare and assign separately

not-stbenjam
and
claude
committed
d984b0d

Navigation Menu

Uh oh!

Add agent-eval step registry and ai-helpers eval presubmit - #79925

Add agent-eval step registry and ai-helpers eval presubmit#79925
openshift-merge-bot[bot] merged 17 commits into
openshift:mainfrom
not-stbenjam:ai-helpers-eval-presubmit

Commits on Jun 1, 2026

Add agent-eval step registry and ai-helpers eval presubmit

Pin mlflow, error on missing setup script, update owners

Add marketplace registration before plugin install

Add hello-world smoke test fallback when eval config missing

Clear EVAL_SETUP_SCRIPT when falling back to smoke test

Use private artifact bucket for eval job

Remove hidden setting from eval job

Use python3 -m pip instead of bare pip

make ci-operator-config

Run mlflow server via python3 -m mlflow

Fix mlflow PATH and SSH host key for plugin install

Fix mlflow, SSH, and PATH issues in eval step

Add comment for mlflow version pin, remove pipe on pip install

Clone eval harness directly, use --plugin-dir

ci: strip hello-world smoke test, fix integration gaps

ci: remove unused EVAL_JUDGE_MODEL env var

ci: fix shellcheck SC2155 — declare and assign separately