Skip to content

Stop all sub processes spawn by acceptance tests#8226

Merged
fab-10 merged 3 commits intobesu-eth:mainfrom
fab-10:stop-besu-subprocess-in-ats
Feb 3, 2025
Merged

Stop all sub processes spawn by acceptance tests#8226
fab-10 merged 3 commits intobesu-eth:mainfrom
fab-10:stop-besu-subprocess-in-ats

Conversation

@fab-10
Copy link
Copy Markdown
Contributor

@fab-10 fab-10 commented Feb 3, 2025

PR description

Re-attempt to fixing flaky ATs by correctly stopping all Besu sub-processes spawn by each ATs, and clearing all they resources.
Since this with this change the BftMiningAcceptanceTest AT takes ~27 mins on CI, it has been split in 3 parts so they can run in parallel and takes around 10 mins each.
ATs are also run sequentially to avoid resources exhaustion due to too many running Besu sub-processes.

Fixed Issue(s)

fixes #7596

Thanks for sending a pull request! Have you done the following?

  • Checked out our contribution guidelines?
  • Considered documentation and added the doc-change-required label to this PR if updates are required.
  • Considered the changelog and included an update if required.
  • For database changes (e.g. KeyValueSegmentIdentifier) considered compatibility and performed forwards and backwards compatibility tests

Locally, you can run these tests to catch failures early:

  • spotless: ./gradlew spotlessApply
  • unit tests: ./gradlew build
  • acceptance tests: ./gradlew acceptanceTest
  • integration tests: ./gradlew integrationTest
  • reference tests: ./gradlew ethereum:referenceTests:referenceTests

@fab-10 fab-10 force-pushed the stop-besu-subprocess-in-ats branch from 8d7b28b to 87e282b Compare February 3, 2025 11:54
Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>
@fab-10 fab-10 force-pushed the stop-besu-subprocess-in-ats branch from 87e282b to 4a28100 Compare February 3, 2025 13:11
Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>
@fab-10 fab-10 force-pushed the stop-besu-subprocess-in-ats branch from 4a28100 to b21502c Compare February 3, 2025 13:47
Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>
@fab-10 fab-10 marked this pull request as ready for review February 3, 2025 14:41
@fab-10 fab-10 enabled auto-merge (squash) February 3, 2025 14:47
@fab-10 fab-10 merged commit d691f45 into besu-eth:main Feb 3, 2025
macfarla added a commit that referenced this pull request Feb 4, 2025
macfarla added a commit to macfarla/besu that referenced this pull request Feb 4, 2025
…)"

This reverts commit d691f45.

Signed-off-by: Sally MacFarlane <macfarla.github@gmail.com>
macfarla added a commit that referenced this pull request Feb 4, 2025
This reverts commit d691f45.

Signed-off-by: Sally MacFarlane <macfarla.github@gmail.com>
pullurib pushed a commit to pullurib/besu that referenced this pull request Feb 6, 2025
* Stop all sub processes spawn by acceptance tests

Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>

* Split long running test in 3 parts

Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>

* Run ATs sequentially

Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>

---------

Signed-off-by: Fabio Di Fabio <fabio.difabio@consensys.net>
Signed-off-by: Bhanu Pulluri <bhanu.pulluri@kaleido.io>
@fab-10 fab-10 deleted the stop-besu-subprocess-in-ats branch February 12, 2025 14:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Acceptance tests do not stop Besu subprocesses causing resource exhaustion

2 participants