Skip to content

Introduce unified test framework for benchmark and functional tests #2803

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
lajagapp wants to merge 42 commits into from
Closed

Introduce unified test framework for benchmark and functional tests #2803

Show file tree
Hide file tree
Changes from 9 commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
2188233
Restructure benchmarks to unified test framework
lajagapp Jan 6, 2026
5adda5a
Add functional test framework with MIOpen driver test
lajagapp Jan 6, 2026
64d9a40
Fix import errors
lajagapp Jan 6, 2026
7db3292
Fix pre-commit errors
lajagapp Jan 6, 2026
ee49925
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 6, 2026
8013e71
Update overall README.md
lajagapp Jan 6, 2026
fb3521b
Merge main into users/lajagapp/add-miopen-driver-test
lajagapp Jan 7, 2026
0d2b187
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 7, 2026
398c9b7
Fix pre-commit errors
lajagapp Jan 7, 2026
7f6bbd3
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 12, 2026
bf9cf14
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 12, 2026
a56f9c4
Refactor test framework READMEs to eliminate duplication
lajagapp Jan 13, 2026
48d75c7
Rename test matrix files for clarity
lajagapp Jan 13, 2026
049af2e
Update functional_base.py
lajagapp Jan 13, 2026
1ef8ecb
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 13, 2026
a5957e3
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 13, 2026
c87ecac
Refactor test_miopendriver_conv.py with JSON result parsing
lajagapp Jan 13, 2026
a9d7c26
Simplify exception handling and enhance functional tests
lajagapp Jan 13, 2026
22d338e
Rename test_framework to extended_tests
lajagapp Jan 13, 2026
23d0b0f
Update test framework name
lajagapp Jan 13, 2026
c0d0ed0
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 14, 2026
9d5f728
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 15, 2026
0112ef5
Update therock_dir path in benchmark scripts
lajagapp Jan 15, 2026
49097fe
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 16, 2026
1f1451b
Add extended functional tests to nightly CI
lajagapp Jan 16, 2026
d752368
Fix pre-commit errors
lajagapp Jan 16, 2026
245c6b0
Restrict extended functional tests to nightly runs only
lajagapp Jan 16, 2026
7181402
Refactor: Improve naming consistency for extended functional tests
lajagapp Jan 19, 2026
82579d5
Docs: Improve extended tests documentation and environment setup guid…
lajagapp Jan 19, 2026
c1839fa
Refactor: Improve naming and documentation for extended test framework
lajagapp Jan 19, 2026
6564b8e
Update functional/README.md
lajagapp Jan 19, 2026
b725f8d
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 19, 2026
6590d7e
Update README with test_extended_functional_tests.yml
lajagapp Jan 20, 2026
f0568fe
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 20, 2026
52cae62
Fix pre-commit errors
lajagapp Jan 20, 2026
7387c37
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 26, 2026
fece860
Restore rocm-libraries submodule to match main
lajagapp Jan 26, 2026
39deb97
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Jan 30, 2026
e9e6ed1
Merge branch 'main' into users/lajagapp/add-miopen-driver-test
lajagapp Feb 2, 2026
49a64c0
Improve functional test logging and remove redundancy
lajagapp Feb 2, 2026
7329da8
Rename functional test workflow for clarity
lajagapp Feb 2, 2026
f58d124
Fix pre-commit errors
lajagapp Feb 2, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
277 changes: 0 additions & 277 deletions build_tools/github_actions/benchmarks/README.md
View file
Open in desktop

This file was deleted.

1 change: 0 additions & 1 deletion build_tools/github_actions/benchmarks/__init__.py
View file
Open in desktop

This file was deleted.

2 changes: 1 addition & 1 deletion build_tools/github_actions/fetch_test_configurations.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
from pathlib import Path

from github_actions_utils import *
from benchmarks.benchmark_test_matrix import benchmark_matrix
from test_framework.benchmark.benchmark_matrix import benchmark_matrix

@geomin12 geomin12 Jan 8, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could we perhaps be more specific than test_framework? maybe extended or a better word

test_framework is broad

@lajagapp lajagapp Jan 13, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the feedback. Renamed top-level folder from test_framework to extended_tests for better clarity and updated all references accordingly.


logging.basicConfig(level=logging.INFO)

Expand Down
Loading
Loading