Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parameterize CTS tests across all available adapters and devices. #2479

Merged
merged 3 commits into from
Jan 13, 2025

Conversation

aarongreig
Copy link
Contributor

No description provided.

@github-actions github-actions bot added ci/cd Continuous integration/devliery conformance Conformance test suite issues. specification Changes or additions to the specification native-cpu Native CPU adapter specific issues labels Dec 18, 2024
@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch from 79a6543 to ea58e4d Compare December 18, 2024 15:54
@github-actions github-actions bot added the hip HIP adapter specific issues label Dec 18, 2024
@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch 4 times, most recently from d881ba8 to 6a1d9ad Compare December 20, 2024 14:08
source/adapters/native_cpu/queue.cpp Outdated Show resolved Hide resolved
test/conformance/device/urDeviceGetGlobalTimestamps.cpp Outdated Show resolved Hide resolved
test/conformance/device/urDeviceGetGlobalTimestamps.cpp Outdated Show resolved Hide resolved
test/conformance/device/urDevicePartition.cpp Outdated Show resolved Hide resolved
test/conformance/device/urDevicePartition.cpp Outdated Show resolved Hide resolved
test/conformance/device/urDevicePartition.cpp Outdated Show resolved Hide resolved
test/conformance/device/urDevicePartition.cpp Outdated Show resolved Hide resolved
@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch from 6b3a61d to aaa1d81 Compare January 3, 2025 16:49
@github-actions github-actions bot added the cuda CUDA adapter specific issues label Jan 3, 2025
@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch from aaa1d81 to 2922a07 Compare January 3, 2025 17:23
@aarongreig aarongreig marked this pull request as ready for review January 3, 2025 17:28
@aarongreig aarongreig requested review from a team as code owners January 3, 2025 17:28
@aarongreig aarongreig requested review from hdelan and Seanst98 January 3, 2025 17:28
@aarongreig
Copy link
Contributor Author

LLVM PR intel/llvm#16519 I think it is worth including the small adapter fix in this, it avoids a lot of extra KNOWN_FAILUREs

Copy link
Contributor

@hdelan hdelan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Command buffer changes LGTM.

Copy link
Contributor

@kbenzie kbenzie left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - we should merge this ASAP so it doesn't bitrot

@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch from 2922a07 to 68ed7e8 Compare January 8, 2025 17:59
aarongreig and others added 2 commits January 10, 2025 11:54
The new `UUR_KNOWN_FAILURE_ON` macro can be used to skip tests on
devices where the test is known to fail. This can be done in the
following situations.

For all devices in an adapter:

```cpp
UUR_KNOWN_FAILURE_ON(uur::LevelZero{});
```

By substring match of the device name within and adapter:

```cpp
UUR_KNOWN_FAILURE_ON(uur::OpenCL{"Intel(R) UHD Graphics 770"});
```

> Note: This invocation is used in a few places in this patch to
> facilitate clean runs when using this decice.

In certain test suits, where there is no access to a device, the
platform name is used instead:

```cpp
UUR_KNOWN_FAILURE_ON(uur::CUDA{"NVIDIA CUDA BACKEND"});
```

When neither device or platform is available in a test suite, the name
is ignored and only the adapter backend is used to determine if the test
is a known failure.

The macro is variadic making it possible to specify known failures for
multiple adapters in a single place and multiple names can also be provided
per adapter:

```cpp
UUR_KNOWN_FAILURE_ON(
    uur::OpenCL{
        "Intel(R) UHD Graphics 750",
        "Intel(R) UHD Graphics 770",
    },
    uur::HIP{"Radeon RX 7700"},
    uur::NativeCPU{});
```
Copy link
Contributor

@omarahmed1111 omarahmed1111 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch from 5038fe9 to 31a9bbf Compare January 10, 2025 16:12
@aarongreig aarongreig force-pushed the aaron/parameterizeDeviceTests branch from 31a9bbf to 778085f Compare January 10, 2025 16:19
@kbenzie kbenzie merged commit c5bf8fd into oneapi-src:main Jan 13, 2025
73 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci/cd Continuous integration/devliery conformance Conformance test suite issues. cuda CUDA adapter specific issues hip HIP adapter specific issues native-cpu Native CPU adapter specific issues specification Changes or additions to the specification
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants