Upgrade everything we can for a chain reset (#353)

* Re-upgrade Substrate

WIP: CASH benchmarks aren't working for some reason (commented out)
 and test is failing due to another account minimal existence issue

Also had to delete GrandpaRpcHandler, but hopefully not needed now?

* Re-add Gateway addresses, which validators now have

Validators are now required to have a minimum CASH balance in order to set session keys, and therefore validate.
On committing a pipeline change, any account with a balance above the minimum is marked as existing in the Substrate account store.
Any account with a balance below the minumum is purged from the account store.

More test coverage needed.

* Really use min balance path in tests

* Attempt to patch issue blocking ingestion

Only filter the blocks that were supported (not dissented), and only allow support or dissent for a given signer.
The vote is being cast only on the support side, dissent is only derived if the chain receives a disagreement with the first one it received.

* Test m10 patch

* Cargo audit fixes

Also upgrade substrate again in order to bump deps. This is using another substrate branch so as not to break the one others are using.

Couldn't update cranelift-codegen without starting to break stuff in substrate.

* Fix first build from integration

* Start to build code substitutes

* New and improved RPCs (#354)

Co-authored-by: Coburn Berry <[email protected]>

* Reorg fixes (#349)

* Add two basic parser fuzzers and Fuzzbuzz integration (#320)

* Add two basic parser fuzzers and Fuzzbuzz integration

* Upgrade substrate / fix compilation

Co-authored-by: Everest Munro-Zeisberger <[email protected]>

* Update integration testing readme (#333)

* Fix lock scen

* Build Ethereum Contract to test Trx Request from Chain (#282)

This patch adds a new contract (and a `TrxRequestBuilder`) which tests executing a trx request from on-chain. The builder is rudimentary, but can be the start of a full-time builder. The contract `Locker` just locks Eth and transfers it to you (the sender)'s account on Gateway. I believe this is currenty failing due to `(Transfer Cash Max 0x...)` failing right now.

Note: the one bug discovered so far is that events from a trx are processed in reverse order. We should ensure we fix that in our new event system. (It was)

* Bump rust version in CI and simplify scenario workflow

* Use saddle 0.1.23

* test dissenting (#356)

* Fix some tests

* Mark failing tests for follow-up

* Fix fetch_eth_blocks and formulate reorg issue (#357)

* Fix fetch_eth_blocks and formulate reorg issue

We don't need workers to abstain, since that creates different behaviors depending on where the 'invalid blockchain' is found.

Also, avoid fetching duplicates in formulating the reorg.
Also, really only fetch `slack` blocks, not `slack + 1`.

* Fix dissent and concordance scenario

* Cleanups (#359)

* Fix up scenarios for moon branch

* Temp work on scens

* Start to diagnose all remaining scen issues

* Make the re-org test consistent, if slightly less cool

* Fix TOB #2 (#362)

Co-authored-by: Geoffrey Hayes <[email protected]>
Co-authored-by: Coburn Berry <[email protected]>
Co-authored-by: Max Wolff <[email protected]>
Co-authored-by: Everest Munro-Zeisberger <[email protected]>
Co-authored-by: Wayne Nilsen <[email protected]>
Co-authored-by: Coburn Berry <[email protected]>

Author: 7 people

Diff for: .github/workflows/test-workflow.yml

@@ -4,23 +4,32 @@ on: push
 # rustc version set with `rustup default` command in scripts/get_substrate.sh
 
 jobs:
+  cargo-audit:
+    name: Cargo Audit Check
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v2
+      - uses: actions-rs/audit-check@v1
+        with:
+          token: ${{ secrets.GITHUB_TOKEN }}
+
   cargo-format:
     name: Cargo Format Check
-    runs-on: ubuntu-20.04
+    runs-on: ubuntu-latest
     steps:
       - name: Checkout repository
         uses: actions/checkout@v2
 
       - name: Cargo fmt
         run: |
-          NIGHTLY=nightly-2021-03-24
+          NIGHTLY=nightly-2021-06-01
           rustup install $NIGHTLY
           rustup component add rustfmt --toolchain $NIGHTLY
           cargo +$NIGHTLY fmt -- --check
 
   substrate-tests:
     name: Substrate Unit Tests
-    runs-on: ubuntu-20.04
+    runs-on: ubuntu-latest
     steps:
       - uses: actions/checkout@v2
       # - uses: actions/cache@v2
@@ -74,7 +83,7 @@ jobs:
 
   substrate-coverage:
     name: Substrate Coverage
-    runs-on: ubuntu-20.04
+    runs-on: ubuntu-latest
     steps:
       - uses: actions/checkout@v2
       # - uses: actions/cache@v2
@@ -220,32 +229,17 @@ jobs:
         run: |
           ./scripts/get_substrate.sh --fast
 
-      - name: Install yarn ethereum dependencies
-        run: cd ethereum && yarn install
-
-      - name: Install integration test ethereum dependencies
-        run: cd integration && yarn install
-
       - name: Install solc
         run: |
           sudo wget https://github.com/ethereum/solidity/releases/download/v0.8.1/solc-static-linux -O /usr/local/bin/solc
           sudo chmod +x /usr/local/bin/solc
 
-      - name: Compile Ethereum contracts
-        run: |
-          cd ethereum
-          yarn compile
-
-      - name: Build Gateway
-        run: |
-          WASM_BUILD_RUSTFLAGS='--cfg feature="integration"' cargo build --release --features integration
+      - name: Install integration test dependencies and build
+        run: cd integration && yarn && yarn build
 
       - name: Run Integration Test
         timeout-minutes: 40
-        run: |
-          set -eo pipefail
-          cd integration
-          sudo PROFILE=release QUIET_SCENARIOS=true npx jest --ci --reporters=default --reporters=jest-junit
+        run: cd integration && sudo yarn test --ci --reporters=default --reporters=jest-junit
 
       - name: Prepublish Integration results
         if: always()