Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lower coverage requirement for prop_selectRandom_one_withAdaOnly. #2844

Merged
merged 1 commit into from
Aug 25, 2021

Conversation

jonathanknowles
Copy link
Contributor

This PR lowers a coverage check requirement in prop_selectRandom_one_withAdaOnly.

It should fix the following failure, which was seen in overnight testing (2 out of 100 runs):

Failures:

  test/unit/Cardano/Wallet/Primitive/Types/UTxOIndexSpec.hs:144:9:
  1) Cardano.Wallet.Primitive.Types.UTxOIndex, Indexed UTxO set properties, Index Selection, prop_selectRandom_one_withAdaOnly
       Insufficient coverage (after 1600 tests):
         85.18% selected an entry

         Only 85.18% selected an entry, but expected 90.00%

  To rerun use: --match "/Cardano.Wallet.Primitive.Types.UTxOIndex/Indexed UTxO set properties/Index Selection/prop_selectRandom_one_withAdaOnly/"

This fixes a flaky coverage check requirement, as seen in overnight
testing (2 out of 100 runs):

```
Failures:

  test/unit/Cardano/Wallet/Primitive/Types/UTxOIndexSpec.hs:144:9:
  1) Cardano.Wallet.Primitive.Types.UTxOIndex, Indexed UTxO set properties, Index Selection, prop_selectRandom_one_withAdaOnly
       Insufficient coverage (after 1600 tests):
         85.18% selected an entry

         Only 85.18% selected an entry, but expected 90.00%

  To rerun use: --match "/Cardano.Wallet.Primitive.Types.UTxOIndex/Indexed UTxO set properties/Index Selection/prop_selectRandom_one_withAdaOnly/"
```
@jonathanknowles jonathanknowles self-assigned this Aug 25, 2021
@jonathanknowles
Copy link
Contributor Author

bors r+

iohk-bors bot added a commit that referenced this pull request Aug 25, 2021
2843: Add functions `{gen,shrink}Tx` to `Primitive.Tx.Gen` r=jonathanknowles a=jonathanknowles

### Issue Number

ADP-1084

### Comments

This PR adds a reusable generator and shrinker for transactions (of type `Tx`) to the `Primitive.Tx.Gen` module.

It uses these functions to simplify or eliminate `Arbitrary` instances in the following modules:
- `Cardano.Wallet.Primitive.ModelSpec`
- `Cardano.Wallet.Primitive.TypesSpec`
- `Cardano.WalletSpec`

2844: Lower coverage requirement for `prop_selectRandom_one_withAdaOnly`. r=jonathanknowles a=jonathanknowles

This PR lowers a coverage check requirement in `prop_selectRandom_one_withAdaOnly`.

It should fix the following failure, which was seen in overnight testing (2 out of 100 runs):

```hs
Failures:

  test/unit/Cardano/Wallet/Primitive/Types/UTxOIndexSpec.hs:144:9:
  1) Cardano.Wallet.Primitive.Types.UTxOIndex, Indexed UTxO set properties, Index Selection, prop_selectRandom_one_withAdaOnly
       Insufficient coverage (after 1600 tests):
         85.18% selected an entry

         Only 85.18% selected an entry, but expected 90.00%

  To rerun use: --match "/Cardano.Wallet.Primitive.Types.UTxOIndex/Indexed UTxO set properties/Index Selection/prop_selectRandom_one_withAdaOnly/"
```

Co-authored-by: Jonathan Knowles <[email protected]>
Co-authored-by: IOHK <[email protected]>
@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 25, 2021

Build failed (retrying...):

  src/Test/Integration/Scenario/CLI/Shelley/Wallets.hs:754:18: 
  1) CLI Specifications, SHELLEY_CLI_WALLETS, WALLETS_UTXO_02 - Utxo statistics works properly
       Waited longer than 90s to resolve action: "Wallet balance is as expected".
[cardano-wallet.network:Warning:2382] [2021-08-25 04:38:48.66 UTC] Connection lost with the node. Network.Socket.recvBuf: resource vanished (Connection reset by peer)
[cardano-wallet.network:Warning:52208] [2021-08-25 04:38:48.66 UTC] Connection lost with the node. Network.Socket.recvBuf: resource vanished (Connection reset by peer)
[cardano-wallet.network:Warning:52641] [2021-08-25 04:38:48.67 UTC] Connection lost with the node. Network.Socket.recvBuf: resource vanished (Connection reset by peer)
[cardano-wallet.network:Warning:2380] [2021-08-25 04:38:48.67 UTC] Connection lost with the node. writev: resource vanished (Broken pipe)
       expected: Quantity 1562000000
        but got: Quantity 0

#2429

#duplicate

iohk-bors bot added a commit that referenced this pull request Aug 25, 2021
2844: Lower coverage requirement for `prop_selectRandom_one_withAdaOnly`. r=jonathanknowles a=jonathanknowles

This PR lowers a coverage check requirement in `prop_selectRandom_one_withAdaOnly`.

It should fix the following failure, which was seen in overnight testing (2 out of 100 runs):

```hs
Failures:

  test/unit/Cardano/Wallet/Primitive/Types/UTxOIndexSpec.hs:144:9:
  1) Cardano.Wallet.Primitive.Types.UTxOIndex, Indexed UTxO set properties, Index Selection, prop_selectRandom_one_withAdaOnly
       Insufficient coverage (after 1600 tests):
         85.18% selected an entry

         Only 85.18% selected an entry, but expected 90.00%

  To rerun use: --match "/Cardano.Wallet.Primitive.Types.UTxOIndex/Indexed UTxO set properties/Index Selection/prop_selectRandom_one_withAdaOnly/"
```

Co-authored-by: Jonathan Knowles <[email protected]>
@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 25, 2021

Build failed:

#expected - cancelled?

@jonathanknowles
Copy link
Contributor Author

bors r+

@cardano-foundation cardano-foundation deleted a comment from iohk-bors bot Aug 25, 2021
@iohk-bors
Copy link
Contributor

iohk-bors bot commented Aug 25, 2021

Build succeeded:

@iohk-bors iohk-bors bot merged commit 0880799 into master Aug 25, 2021
@iohk-bors iohk-bors bot deleted the jonathanknowles/fix-flaky-coverage-check branch August 25, 2021 05:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants