Skip to content

Releases: ethereum/execution-spec-tests

[email protected]

01 Oct 22:30
@github-actions github-actions
[email protected]
a796b49
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

⚠️ Note these tests are up to date with the latest devnet-7 spec!

This release is filled with a specific geth branch gballet/jsign-witness-fix aligned with devnet-7. It contains updates and fixes for the past genesis tests due to the addition of witness checks within the testing framework. These verify the correct behavoiur of the witness for specific test cases if defined.

A reasonable order of steps for client teams to start running tests can be found below, starting with the genesis tests from: fixtures_verkle-genesis.tar.gz

  • Run the EIP-6800 tests for a good first check, fixtures/verkle/eip6800_genesis_verkle_tree/ within the extracted the fixture genesis tar.
    • Followed by EIP-4762 tests: fixtures/verkle/eip4762_verkle_gas_witness/.
    • And EIP-7709 tests: fixtures/verkle/eip7709_blockhash_witness/.
  • Run "backfilled" tests, all previous fork tests filled for Verkle, i.e all tests excludingfixtures/verkle/*.
  • (Optional) Run the fixtures_verkle-conversion-stride-0.tar.gz tests, as these contain basic pre-fork tests to make sure nothing is broken on the fork before Verkle.

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v0.0.4

🐘 Verkle Genesis Test Fixtures

Contains verkle specific test vectors from #659 including all existing EEST test cases filled for a verkle configured fork. Note these tests assume the MPT to VKT conversion has completed where we start at the Verkle fork.

Please use fixtures_verkle-genesis.tar.gz!

Generating Genesis Fixtures

Using the geth evm binary from this commit, fill with the following command:

fill --fork Verkle --evm-bin=<path_to_geth_evm> -n auto -m blockchain_test

🔁 Verkle Conversion Test Fixtures - 0 Stride

These aim to verify a basic fork transition from Shanghai to Verkle. 0 stride denotes that the initial MPT remains frozen. Thus the MPT is not being converted to a VKT within these tests. The intention is to check that only blocks after the transition update the VKT, isolating VKT fork transition issues without touching MPT stride conversion logic.

Test cases additionally include Shanghai genesis tests to assert that the fork before Verkle is not broken.

Please use fixtures_verkle-conversion-stride-0.tar.gz!

Generating Conversion Fixtures

Using the geth evm binary from this commit, fill with the following command:

fill --from Shanghai --until EIP6800Transition --evm-bin=<path_to_geth_evm> -n auto -m blockchain_test
Assets 4
Loading

[email protected]

23 Sep 19:28
@github-actions github-actions
[email protected]
b035ad3
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Filled using Besu commit hyperledger/besu@0d63955

What's Changed

  • new(tests): EOF - EIP-7620 EOFCREATE gas testing by @pdobacz in #785

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.1.1

Contributors

pdobacz
Assets 4
Loading

[email protected]

19 Sep 18:41
@github-actions github-actions
[email protected]
c0a381c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Contains several EIP-7702 Devnet-3 tests parametrized to use EOF.

What's Changed

  • chore(tests): update EOF tests tracker by @chfast in #791
  • new(tests): EOF: more fuzzing disovered tests by @shemnon in #789
  • fix(fw): DATALOAD pushed_stack_items by @pdobacz in #784
  • new(tests): EOF: tests for invalid non-returning sections by @chfast in #794
  • new(tests): EOF - EIP-7069 - expand EXT*CALL gas testing by @pdobacz in #771
  • fix(tests): EOF - Remove duplicate container tests, automatically check for duplicates by @marioevz in #800
  • fix(fw): max stack height calculation in add by @pdobacz in #810
  • new(test): EIP-7702 + EIP-1153: test that TransientStorage stays at correct address by @jochem-brouwer in #799
  • new(tests): TSTORE: ensure transient storage is cleared after transactions by @jochem-brouwer in #798
  • new(tests): EOF - EIP-7620: EOFCREATE referencing the same subcontainer twice by @MariusVanDerWijden in #809
  • new(tests): EOF - EIP-7620: Dangling data in subcontainer test by @shemnon in #812
  • fix(fw): EOF - Accept initcode_prefix on EOF Container.Init by @marioevz in #819
  • fix(tests): Fix Existing EOF + EIP-7702 Tests by @marioevz in #821

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.1.0

Contributors

shemnon, chfast, and 4 other contributors
Assets 4
Loading

[email protected]

10 Sep 15:14
@github-actions github-actions
[email protected]
52c1df2
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Adds tests/prague/eip7702_set_code_tx/test_set_code_txs.py::test_contract_creating_set_code_transaction which is the contract creating type-4 transaction test.

Important Notes

  • EIP-2935 slow tests (256+ blocks) have been skipped.

Included EIPs

Missing EIPs

Assets 3
Loading

[email protected]

06 Sep 14:10
@marioevz marioevz
[email protected]
52aa13d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Important Notes

EIP-7702 breaks Prague+EOF tests at the moment, therefore this release does not contain them, but they should be expected at a later release.

What's Changed

  • fix(docs): Add some more cases to EOF tracker by @gumb0 in #747
  • new(tests): EOF - EIP-3540: Migrate validation tests: EIP3540/validInvalidFiller.yml by @chfast in #598
  • new(tests): EOF - EIP-7620: tests for msg.depth and static flag by @pdobacz in #732
  • new(tests): EOF - EIP-7069: Call Gas Testing for EXT*CALL by @shemnon in #713
  • new(tests): EIP-7069 - EXTCALL with balance and other by @pdobacz in #755
  • new(tests): EOF - EIP-3540: Test types with 128 inputs by @gurukamath in #749
  • new(tests): EOF - EIP-3540: out of order container section by @chfast in #741
  • chore: simplify python project config by @danceratopz in #764
  • feat(tests): Add multiple exception support to EOF tests by @shemnon in #759
  • new(tests): EOF - EIP-7620: migrate "embedded container" tests by @chfast in #763
  • new(tests): EIP-5656/7692 - use new marker to EOF-ize MCOPY test (2) by @pdobacz in #754
  • feat(tests): EOF - EIP-3540/EIP-4200: Move and rename oritests by @winsvega in #731
  • new(tests): EOF - Tests from Fuzzing by @shemnon in #756
  • feat(docs/tests): EOF: Update tracker, add unimplemented tests by @marioevz in #773
  • new(tests): EOF: Validate EOF only opcodes are invalid in legacy by @shemnon in #768

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.0.9

Contributors

shemnon, chfast, and 6 other contributors
Assets 3
Loading

[email protected]

28 Aug 18:35
@github-actions github-actions
[email protected]
6b893da
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Fixes to test_set_code_using_invalid_signatures where the test expected an invalid transaction in some cases where only an invalid authorization list element was expected (but a valid transaction): e70d831

Important Notes

  • EIP-2935 slow tests (256+ blocks) have been skipped.

Included EIPs

Missing EIPs

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.4.0

Assets 3
Loading

[email protected]

28 Aug 15:27
@github-actions github-actions
[email protected]
1d040a0
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

This is a hotfix release that contains no new tests but fixes an issue during filling where the system account (0xfffffffffffffffffffffffffffffffffffffffe) had its nonce increased in blockchain tests.

Important Notes

  • EIP-2935 slow tests (256+ blocks) have been skipped.

Included EIPs

Missing EIPs

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.3.0

Assets 3
Loading

[email protected]

27 Aug 19:27
@github-actions github-actions
[email protected]
1d040a0
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Third release for Pectra Devnet-3, filled again using EthereumJS transition tool implementation which includes fixes to the state root expected in state tests (thanks again @jochem-brouwer!).

Fixes

  • In previous release, in the state tests, the system contracts' addresses were touched even though the contracts were not present in the pre-alloc.

Important Notes

  • EIP-2935 slow tests (256+ blocks) have been skipped.

Included EIPs

Missing EIPs

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.2.0

Contributors

jochem-brouwer
Assets 3
Loading

[email protected]

26 Aug 14:29
@github-actions github-actions
[email protected]
afe5dd6
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

⚠️ Note these tests are up to date with the latest devnet-7 spec!

This release is equivalent to [email protected] but filled with the latest geth gballet/kaustinen-with-shapella branch aligned with devnet-7.

From the VIC no 23 testing slides, a reasonable order of steps for client teams to start running tests can be found below, starting with the genesis tests from: fixtures_verkle-genesis.tar.gz

  • Run EIP-6800 tests (~23) for a good first check, fixtures/verkle/eip6800_genesis_verkle_tree/ within the extracted the fixture genesis tar.
  • Run "backfilled" tests (~300), all tests excludingfixtures/verkle/*.
  • Wait for the next release to run additonal tests after framework witness assertions verify the remaining test cases.

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v0.0.3

🌪️ Fixture Format Changes

All fixtures now contain a block witness although currently without the parent state root.

class Witness(CamelModel):
    state_diff: StateDiff
    verkle_proof: VerkleProof

Client test consumers can now utilize this to compare there computed block witness against the witness contained within the fixtures (computed from geth's t8n).

For more information on our witness definition please adhere to src/ethereum_test_types/verkle/types.py.

Additionally the post state is removed. Future fixture releases will contain the post state as a VKT.

🐘 Verkle Genesis Test Fixtures

Contains verkle specific test vectors from #659 including all existing EEST test cases filled for a verkle configured fork. Note these tests assume the MPT to VKT conversion has completed where we start at the Verkle fork.

Please use fixtures_verkle-genesis.tar.gz!

Generating Genesis Fixtures

Using the geth evm binary from this commit, fill with the following command:

fill --fork Verkle --evm-bin=<path_to_geth_evm> -n auto -m blockchain_test

🔁 Verkle Conversion Test Fixtures - 0 Stride

Contains an improvement to the initial set of transition tests.

These aim to verify a basic fork transition from Shanghai to Verkle. 0 stride denotes that the initial MPT remains frozen. Thus the MPT is not being converted to a VKT within these tests. The intention is to check that only blocks after the transition update the VKT, isolating VKT fork transition issues without touching MPT stride conversion logic.

Test cases additionally include Shanghai genesis tests to assert that the fork before Verkle is not broken.

The next release will contain conversion tests with some stride enabled to dynamically validate the MPT conversion.

Please use fixtures_verkle-conversion-stride-0.tar.gz!

Generating Conversion Fixtures

Using the geth evm binary from this commit, fill with the following command:

fill --from Shanghai --until EIP6800Transition --evm-bin=<path_to_geth_evm> -n auto -m blockchain_test
Assets 4
Loading

[email protected]

23 Aug 17:49
@github-actions github-actions
[email protected]
7a1777e
Compare
Choose a tag to compare
[email protected] Pre-release
Pre-release

Second release for Pectra Devnet-3, filled again using EthereumJS transition tool implementation which included gas accounting fixes (thanks again @jochem-brouwer!).

Fixes

  • Added re-authorization gas costs tests, i.e. existing set-code in account receives a new delegation (c27e010)
  • Fixed warm account costs to consider cost to access the delegated-to account (59ec505)

Important Notes

  • EIP-2935 slow tests (256+ blocks) have been skipped.

Included EIPs

Missing EIPs

Full Changelog: https://github.com/ethereum/execution-spec-tests/compare/[email protected]@v1.1.0

Contributors

jochem-brouwer
Assets 3
Loading