Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cabal-validate: Steps are not granular enough, add groups of steps #10563

Open
9999years opened this issue Nov 20, 2024 · 0 comments
Open

cabal-validate: Steps are not granular enough, add groups of steps #10563

9999years opened this issue Nov 20, 2024 · 0 comments
Labels
cabal-validate validate.sh (cabal-validate) test suite runner meta: tracking re: devx Improving the cabal developer experience (internal issue) type: testing Issues about project test suites

Comments

@9999years
Copy link
Collaborator

Each --step in cabal-validate runs multiple test suites.

This makes it difficult to pinpoint which test suite caused a failure. This also makes rerunning tests (while fixing a failure) take longer than it needs to, because you may need to wait for unrelated test suites to finish. (The --pattern option usually helps, though.)

Proposal: Make steps run a single test suite instead of multiple, and introduce 'groups' to run multiple steps.

It might be nice if groups/steps have a nesting hierarchy, e.g. build builds everything, build-lib builds Cabal, Cabal-hooks, etc., and build-Cabal builds Cabal only.

@9999years 9999years added meta: tracking re: devx Improving the cabal developer experience (internal issue) type: testing Issues about project test suites cabal-validate validate.sh (cabal-validate) test suite runner labels Nov 20, 2024
@9999years 9999years changed the title cabal-validate: Steps are not granular enough cabal-validate: Steps are not granular enough, add groups of steps Nov 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cabal-validate validate.sh (cabal-validate) test suite runner meta: tracking re: devx Improving the cabal developer experience (internal issue) type: testing Issues about project test suites
Projects
None yet
Development

No branches or pull requests

1 participant