Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add codex-release-tests workflow #108

Closed
veaceslavdoina opened this issue Nov 26, 2024 · 4 comments
Closed

Add codex-release-tests workflow #108

veaceslavdoina opened this issue Nov 26, 2024 · 4 comments
Assignees
@veaceslavdoina
Labels
E:Distributed Client Testing See [insert issue/discussion] for details

Comments

@veaceslavdoina
Copy link
Contributor

veaceslavdoina commented Nov 26, 2024 •
edited
Loading

@benbierens already started to implement run-codex-release-tests.yaml which is planed to be used to test Codex pre-releases images check in a single click.

  • The workflow should start dotnet test ./Tests/CodexReleaseTests
  • The workflow should show the normal console output for this run
  • It's OK if the workflow takes a long time.

The goal is to give a push-button solution so anyone can run the "release required" dist-tests for a codex image.

We already have some workflows implemented and a Docker image with a custom docker-entrypoint.sh. It would be good to adjust and reuse it.

Also, we should add basic documentation how to use it.
@veaceslavdoina veaceslavdoina added the E:Distributed Client Testing See [insert issue/discussion] for details label Nov 26, 2024
@veaceslavdoina veaceslavdoina self-assigned this Nov 26, 2024
@benbierens
Copy link
Contributor

Branch "feature/release-tests-cleanup"

Previously "CodexTests" are now split into

"CodexReleaseTests" - Anyone should be able to run these on any Codex dist-test docker image. These tests should reliably pass for any future release of Codex. These tests will be updated and extended as Codex changes.

"ExperimentalTests" - I use these to diagnose issues and help track down bugs. These tests do not reliably pass and they don't need to.

"FrameworkTests" - Tests for the testing framework.

"CodexContinuousTests" and "CodexTestsLong" have not been changed for a while.

@veaceslavdoina
Copy link
Contributor Author

Thanks, so we do not have anymore just dist-tests and I will clean-up the stuff we have for them.

veaceslavdoina added a commit that referenced this issue Nov 28, 2024
@veaceslavdoina
Rename d-tests and c-tests jobs templates (#108)
b5fd895
veaceslavdoina added a commit that referenced this issue Nov 28, 2024
@veaceslavdoina
Adjust Docker entrypoint (#108)
8d5f686
veaceslavdoina added a commit that referenced this issue Nov 28, 2024
@veaceslavdoina
Add Release tests workflow and job template (#108)
88a1c6d
@veaceslavdoina veaceslavdoina mentioned this issue Nov 28, 2024
Merged
veaceslavdoina added a commit that referenced this issue Nov 28, 2024
@veaceslavdoina
Add Release tests workflow and job template (#108)
58ed7ad
@veaceslavdoina
Copy link
Contributor Author

Single button was implemented and we can test it after some tests will be updated - Run Release Tests.

Image

@veaceslavdoina
Copy link
Contributor Author

Changes were merged and we've performed some runs

Workflow works as expected.

veaceslavdoina added a commit that referenced this issue Dec 2, 2024
@veaceslavdoina
Set workflow status from Kubernetes job (#108)
c5dfd61
@veaceslavdoina veaceslavdoina mentioned this issue Dec 2, 2024
Merged
veaceslavdoina added a commit that referenced this issue Dec 2, 2024
@veaceslavdoina
Set workflow status from Kubernetes job (#108) (#112)
047384a
This was referenced Dec 2, 2024
Merged
Merged
Merged
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 3, 2024
@veaceslavdoina
Refactor Docker reusable workflow and add release tests support
75df584 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 3, 2024
@veaceslavdoina
Add an option to run release tests for Docker images
60a0174 
codex-storage/cs-codex-dist-tests#108
@veaceslavdoina veaceslavdoina mentioned this issue Dec 3, 2024
Merged
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 3, 2024
@veaceslavdoina
Use bigger instance for arm builds
215ead3 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit that referenced this issue Dec 4, 2024
@veaceslavdoina
Pass repository and branch to release tests workflow (#108)
bcdd3b0
@veaceslavdoina veaceslavdoina mentioned this issue Dec 4, 2024
Merged
veaceslavdoina added a commit that referenced this issue Dec 4, 2024
@veaceslavdoina
Pass repository and branch to release tests workflow (#108) (#117)
770ba6d
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Pass repository and branch to release tests workflow
1e9c43e 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Do not use computation job because run_release_tests is a string
f6989ed 
codex-storage/cs-codex-dist-tests#108
github-merge-queue bot pushed a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Run release tests for docker images (#1017)
6d9ec17 
* Refactor Docker reusable workflow and add release tests support

codex-storage/cs-codex-dist-tests#108

* Add an option to run release tests for Docker images

codex-storage/cs-codex-dist-tests#108

* Use bigger instance for arm builds

codex-storage/cs-codex-dist-tests#108

* Pass repository and branch to release tests workflow

codex-storage/cs-codex-dist-tests#108

* Do not use computation job because run_release_tests is a string

codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Do not use computation job because run_release_tests is a string
ecc9069 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Refactor Docker reusable workflow and add release tests support
b912672 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Add an option to run release tests for Docker images
f32de7e 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Use bigger instance for arm builds
d70d7c5 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Pass repository and branch to release tests workflow
c29b13d 
codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Do not use computation job because run_release_tests is a string
1e4ef6e 
codex-storage/cs-codex-dist-tests#108
github-merge-queue bot pushed a commit to codex-storage/nim-codex that referenced this issue Dec 4, 2024
@veaceslavdoina
Run release tests for docker images (#1017)
921159f 
* Refactor Docker reusable workflow and add release tests support

codex-storage/cs-codex-dist-tests#108

* Add an option to run release tests for Docker images

codex-storage/cs-codex-dist-tests#108

* Use bigger instance for arm builds

codex-storage/cs-codex-dist-tests#108

* Pass repository and branch to release tests workflow

codex-storage/cs-codex-dist-tests#108

* Do not use computation job because run_release_tests is a string

codex-storage/cs-codex-dist-tests#108
veaceslavdoina added a commit that referenced this issue Dec 16, 2024
@veaceslavdoina
ci: run-release-tests workflow adjustment (#108)
9bbd9a3
@veaceslavdoina veaceslavdoina mentioned this issue Dec 16, 2024
Merged
veaceslavdoina added a commit that referenced this issue Dec 16, 2024
@veaceslavdoina
ci: run-release-tests workflow adjustment (#108) (#118)
c24861e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@veaceslavdoina veaceslavdoina

Labels
E:Distributed Client Testing See [insert issue/discussion] for details
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@veaceslavdoina @benbierens