Skip to content

[DNM] Zombienet sdk native provider#8728

Closed
lrubasze wants to merge 68 commits intojv-zombie-testsfrom
zombienet-sdk-local-provider
Closed

[DNM] Zombienet sdk native provider#8728
lrubasze wants to merge 68 commits intojv-zombie-testsfrom
zombienet-sdk-local-provider

Conversation

@lrubasze
Copy link
Contributor

@lrubasze lrubasze commented Jun 3, 2025

This is to test zombienet-sdk CI with native provider

@lrubasze lrubasze requested review from a team as code owners June 3, 2025 11:16
@lrubasze lrubasze added R0-no-crate-publish-required The change does not require any crates to be re-published. T10-tests This PR/Issue is related to tests. T18-zombienet_tests Trigger zombienet CI tests. labels Jun 3, 2025
@bkontur
Copy link
Contributor

bkontur commented Jun 3, 2025

This is to test zombienet-sdk CI with native provider

I tried to use zombienet-sdk Native provider for polkadot-fellows repo and run it with different polkadot/polkadot-parachain versions: polkadot-fellows/runtimes#676 - it was working.
(not sure, if this could be useful for you, maybe just worth to check)

@pepoviola
Copy link
Contributor

Hey, using native in our CI is possible but to do it we need:

Spawn a bigger runner (or use parity-default / parity-large)
Download the binaries, as you do here. But keep in mind the retention time of the artifacts (we should ping @alvicsam to confirm).

Also, we should ensure that all the needed nodes fit on the runner (maybe we can mix native for smoke test and k8s for more complex/biggers ones).
Thx!!

Comment on lines 1 to 6
ZOMBIE_PROVIDER=native
ZOMBIENET_SDK_IMAGE_FOR_NATIVE=docker.io/paritytech/ci-unified:bullseye-1.84.1-2025-01-28-v202502131220
ZOMBIENET_SDK_RUNNER_FOR_NATIVE=parity-large
ZOMBIENET_SDK_IMAGE_FOR_K8S=docker.io/paritytech/zombienet:v1.3.129
ZOMBIENET_SDK_RUNNER_FOR_K8S=parity-zombienet
RUST_LOG=info,zombienet_orchestrator=trace,cumulus_zombienet_sdk_helpers=debug
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lrubasze Is this file used?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, this file is here
It keeps settings for zombienet-sdk.
This way we can separately configure zombienet and zombienet-sdk

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ahh oks, but we can merge into one file for the final version of the pr. 👍

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I decided to separate files to have clear distinction between options for zombienet and zombienet-sdk.
Unfortunately we cannot put comments in this file because of the way those files are used to inject options into GH environment.
So if we merge into one we shall make sure variables are named in a descriptive way.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, we can use ZOMBIENET_SDK prefix in all vars related to sdk (only this one is needed to change ZOMBIE_PROVIDER). RUST_LOG could maintain without change since will not have effect in v1.

@paritytech-workflow-stopper
Copy link

All GitHub workflows were cancelled due to failure one of the required jobs.
Failed workflow url: https://github.com/paritytech/polkadot-sdk/actions/runs/15629995717
Failed job name: test-linux-stable

@lrubasze lrubasze force-pushed the zombienet-sdk-local-provider branch from c8218be to 0f5ffeb Compare June 13, 2025 09:44
@lrubasze
Copy link
Contributor Author

lrubasze commented Jun 13, 2025

Polkadot test results from 2025-06-12
Different tests: 25
Test cycles: 58
Tests total: 1450
Test failed: 6
Test cycles failed: 6

image

@lrubasze
Copy link
Contributor Author

Polkadot test results from 2025-06-13
Different tests: 26
Test cycles: 38
Tests total: 988
Test failed: 7
Test cycles failed: 7

image

@lrubasze
Copy link
Contributor Author

lrubasze commented Jun 13, 2025

Polkadot test results from randomly picked day 2025-05-16 (before stabilization was started)
Different tests: 31
Test cycles: 17
Tests total: 527
Test failed: 72
Test cycles failed: 17
image

@lrubasze lrubasze closed this Jun 24, 2025
@lrubasze
Copy link
Contributor Author

Work continued in #8748

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

R0-no-crate-publish-required The change does not require any crates to be re-published. T10-tests This PR/Issue is related to tests. T18-zombienet_tests Trigger zombienet CI tests.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants