Skip to content

fix(ci): fix api rate limiting issue in consume flow #1818

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
danceratopz merged 2 commits into from
Nov 27, 2025
Merged

fix(ci): fix api rate limiting issue in consume flow #1818

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f4e0db8
fix(ci): use url instead of release specifier to avoid rate limits
danceratopz Nov 27, 2025
dbbef3e
refactor(ci): use pre-defined client file in consume flow
danceratopz Nov 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions .github/configs/hive/master.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Hive client configuration file with master/nightly images for CI
# Uses ethpandaops mirror for faster pulls in CI environments

# Geth (Go-Ethereum)
- client: go-ethereum
nametag: default
build_args:
baseimage: docker.ethquokkaops.io/dh/ethpandaops/geth
tag: master
26 changes: 8 additions & 18 deletions .github/workflows/hive-consume.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,10 @@ concurrency:
group: hive-consume-${{ github.workflow }}-${{ github.ref || github.run_id }}
cancel-in-progress: true

env:
# Use direct URL instead of release spec (e.g., develop@v5.3.0) to avoid GitHub API rate limits
FIXTURES_URL: https://github.com/ethereum/execution-spec-tests/releases/download/v5.3.0/fixtures_develop.tar.gz

jobs:
test-hive:
name: ${{ matrix.name }}
Expand All @@ -41,7 +45,6 @@ jobs:
consume_command: engine
steps:
- name: Checkout execution-specs
if: matrix.mode == 'dev'
uses: actions/checkout@08c6903cd8c0fde910a37f88322edcfb5dd907a8 # v5.0.0
with:
path: execution-specs
Expand All @@ -68,19 +71,6 @@ jobs:
version: ${{ vars.UV_VERSION }}
python-version: ${{ vars.DEFAULT_PYTHON_VERSION }}

- name: Pre-pull geth docker image
run: docker pull docker.ethquokkaops.io/dh/ethpandaops/geth:master

- name: Create clients.yaml
run: |
cat > hive/clients.yaml << 'EOF'
- client: go-ethereum
nametag: default
build_args:
baseimage: docker.ethquokkaops.io/dh/ethpandaops/geth
tag: master
EOF

- name: Build hive
run: |
cd hive
Expand All @@ -93,16 +83,16 @@ jobs:
./hive --sim '${{ matrix.simulator }}' \
--sim.parallelism=1 \
--client go-ethereum \
--client-file clients.yaml \
--sim.buildarg fixtures=develop@v5.3.0 \
--client-file ../execution-specs/.github/configs/hive/master.yaml \
--sim.buildarg fixtures=${{ env.FIXTURES_URL }} \
--sim.limit=".*test_block_at_rlp_limit_with_logs.*Osaka.*" \
--docker.output

- name: Start Hive in dev mode
if: matrix.mode == 'dev'
run: |
cd hive
./hive --dev --client go-ethereum --client-file clients.yaml --docker.output &
./hive --dev --client go-ethereum --client-file ../execution-specs/.github/configs/hive/master.yaml --docker.output &
echo "Waiting for Hive to be ready..."
for i in {1..30}; do
if curl -s http://127.0.0.1:3000 > /dev/null 2>&1; then
Expand All @@ -120,4 +110,4 @@ jobs:
HIVE_SIMULATOR: http://127.0.0.1:3000
run: |
uv sync --all-extras
uv run consume ${{ matrix.consume_command }} --input develop@v5.3.0 -k "Osaka and test_block_at_rlp_limit_with_logs"
uv run consume ${{ matrix.consume_command }} --input ${{ env.FIXTURES_URL }} -k "Osaka and test_block_at_rlp_limit_with_logs"
Loading