Skip to content

Refactor CI to use Subway as RPC proxy/cache instead of Chopsticks#519

Merged
xlc merged 5 commits into
masterfrom
refactor-ci
Feb 15, 2026
Merged

Refactor CI to use Subway as RPC proxy/cache instead of Chopsticks#519
xlc merged 5 commits into
masterfrom
refactor-ci

Conversation

@rockbmb

@rockbmb rockbmb commented Feb 13, 2026

Copy link
Copy Markdown
Collaborator

This is related to #513 .

I lifted my work from polkadot-fellows/runtimes#1068, and implemented it here, in the CI/Snapshot Update workflows.

Summary:

  • new folder in .github/subway-configs; it contains Subway configs for the RPC proxies that will be created during CI: one for each Polkadot/Kusama chain that has test suites containing *.e2e.* in their filenames.
    • E2E tests are the heaviest in terms of network requests, particularly repeated queries for the same data e.g. block hashes and storage; XCM connectivity tests can be superiorly bounded at 10-100 roundtrips, so a cache is not mandatory in these cases.
  • Workflow in .github/workflows/ci.yml refactored the Chopsticks-as-cache mechanism introduced in Use chopsticks as cache to avoid RPC stalling in CI workflow #506/Rework CI to use Chopsticks servers to reduce RPC load #504 to instead use Subway for RPC caching per @xlc's suggestion
    • it uses a matrix strategy with two jobs, one for each network: Polkadot and Kusama
      • each of these jobs with share the Subway servers started for chains in that network among themselves, as their endpoints will have been injected into .env
    • it limits concurrency to 2 test files running simultaneously

@rockbmb rockbmb added this to the Refactors & redesigns milestone Feb 13, 2026
@rockbmb rockbmb self-assigned this Feb 13, 2026
@rockbmb rockbmb added enhancement New feature or request ci labels Feb 13, 2026

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Found configuration errors in Subway config files (incorrect endpoints, duplicate entries) and a logic issue in the GitHub Actions workflows where caching is attempted before the repository is cloned.

Comment thread .github/subway-configs/asset-hub-kusama.yml Outdated
Comment thread .github/subway-configs/people-polkadot.yml
Comment thread .github/workflows/ci.yml Outdated
Comment thread .github/workflows/update-snapshot.yml Outdated
This ensures Cargo.lock is available for the cache key calculation and
the directory exists for restoration.
@xlc xlc merged commit b4c35b7 into master Feb 15, 2026
7 checks passed
@xlc xlc deleted the refactor-ci branch February 15, 2026 20:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants