Skip to content

chore(ci): optimize Docker setup for ephemeral K8s pod runners #348

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
key4ng merged 11 commits into from
Feb 6, 2026
Merged

chore(ci): optimize Docker setup for ephemeral K8s pod runners #348

Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
422684f
cache docker image
key4ng Feb 6, 2026
6538639
please work
key4ng Feb 6, 2026
ee0df13
boost test
key4ng Feb 6, 2026
606f01f
clean
key4ng Feb 6, 2026
f1c6d55
fix intendent
key4ng Feb 6, 2026
0fc7edd
remove docker clean step as k8s pod is ephemeral, everything destroye…
key4ng Feb 6, 2026
712461a
update the cache key
key4ng Feb 6, 2026
50662f8
use fast start image
key4ng Feb 6, 2026
c81f8bb
test
key4ng Feb 6, 2026
388ac0f
warm up docker daemon
key4ng Feb 6, 2026
d158eff
lint
key4ng Feb 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
38 changes: 17 additions & 21 deletions .github/workflows/pr-test-rust.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -290,6 +290,10 @@ jobs:
- name: Checkout code
uses: actions/checkout@v6

- name: Warm up Docker daemon
if: matrix.setup_oracle || matrix.setup_brave
run: docker info > /dev/null 2>&1

- name: Setup vLLM backend
if: matrix.setup_vllm
uses: ./.github/actions/setup-vllm
Expand All @@ -301,6 +305,18 @@ jobs:
- name: Setup SGLang backend
if: ${{ !matrix.setup_vllm && !matrix.setup_trtllm }}
uses: ./.github/actions/setup-sglang

- name: Download wheel artifact
uses: actions/download-artifact@v7
with:
name: smg-wheel
path: wheel/

- name: Install wheel and test dependencies
run: |
pip uninstall -y smg || true
pip install wheel/*.whl
bash scripts/ci_install_e2e_deps.sh ${{ matrix.extra_deps }}

- name: Setup Oracle Instant Client
if: matrix.setup_oracle
Expand All @@ -325,7 +341,7 @@ jobs:
- name: Start Oracle Database
if: matrix.setup_oracle
run: |
docker run -d -p 1521:1521 -e ORACLE_PASSWORD=oracle --name oracle-db gvenzl/oracle-xe:21-slim
docker run -d --rm -p 1521:1521 -e ORACLE_PASSWORD=oracle --name oracle-db gvenzl/oracle-xe:21-slim-faststart
echo "Starting Oracle DB..."

# Export Oracle connection environment variables
Expand All @@ -347,18 +363,6 @@ jobs:
sleep 2
curl -f --max-time 1 http://localhost:8001/sse > /dev/null 2>&1 && echo "Brave MCP Server is healthy!" || echo "Brave MCP Server responded"

- name: Download wheel artifact
uses: actions/download-artifact@v7
with:
name: smg-wheel
path: wheel/

- name: Install wheel and test dependencies
run: |
pip uninstall -y smg || true
pip install wheel/*.whl
bash scripts/ci_install_e2e_deps.sh ${{ matrix.extra_deps }}

- name: Run E2E tests
env:
HF_TOKEN: ${{ secrets.HF_TOKEN }}
Expand All @@ -373,14 +377,6 @@ jobs:
name: genai-bench-results-all-policies
path: benchmark_**/

- name: Cleanup Brave MCP Server
if: always() && matrix.setup_brave
run: docker rm -f brave-search-server || true

- name: Cleanup Oracle Database
if: always() && matrix.setup_oracle
run: docker rm -f oracle-db || true

go-unit-tests:
name: go-unit-tests
needs: [check-ci, build-wheel]
Expand Down