[Beanavil]

Motivation

Add CCCL 3.1.x support to hipCUB and rocPRIM libraries.

JIRA ID : EXSWSTRHPC-320

Technical Details

Branch is based on the staging branch, which includes all the CCCL 3.0.x updates.

Most relevant changes:

• Added support for large number of segments and large number of items to DeviceSegmentedRadixSort
• Added WarpReduce overloadings
• Added fixed size segmented reduce
• Removed deprecated thread operators
• Added support for large num_segments to DeviceSegmentedReduce with fixed segment size
• Added support for large number of items to DeviceRunLengthEncode::Encode
• Added env-based API for DeviceReduce
• Bumped CCCL version to 3.1.4
• Promoted libhipcxx to hard-dependency, also on Windows

Test Plan

Internal+AMD's CI runs

Test Result

Internal CI passes. AMD CI should be checked now

Submission Checklist

• Look over the contributing guidelines at https://github.com/ROCm/ROCm/blob/develop/CONTRIBUTING.md#pull-requests.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

Additional details and impacted files

@@                       Coverage Diff                       @@
##           users/naraenda/ccl-staging   #11292       +/-   ##
===============================================================
+ Coverage                       69.42%   93.08%   +23.67%     
===============================================================
  Files                            2828      468     -2360     
  Lines                          470113    39974   -430139     
  Branches                        69417     5074    -64343     
===============================================================
- Hits                           326338    37209   -289129     
+ Misses                         120069     2432   -117637     
+ Partials                        23706      333    -23373     

Flag	Coverage Δ
TensileLite-CPP	?
TensileLite-Unit	?
hipBLAS	?
hipBLASLt	?
hipCUB	?
hipDNN	?
hipFFT	?
hipRAND	?
hipSOLVER	?
hipSPARSE	?
rocBLAS	?
rocFFT	?
rocRAND	?
rocSOLVER	?
rocSPARSE	?
rocThrust	93.08% <ø> (+1.49%)	⬆️

Files with missing lines	Coverage Δ
projects/rocthrust/test/test_address_stability.cpp	94.59% <ø> (ø)
projects/rocthrust/test/test_allocator.cpp	94.64% <ø> (ø)
...s/rocthrust/test/test_allocator_aware_policies.cpp	100.00% <ø> (ø)
projects/rocthrust/test/test_binary_search.cpp	99.41% <ø> (ø)
projects/rocthrust/test/test_complex.cpp	98.45% <ø> (ø)
projects/rocthrust/test/test_constant_iterator.cpp	100.00% <ø> (ø)
projects/rocthrust/test/test_copy.cpp	96.85% <ø> (ø)
projects/rocthrust/test/test_counting_iterator.cpp	99.40% <ø> (ø)
projects/rocthrust/test/test_dereference.cpp	100.00% <ø> (ø)
projects/rocthrust/test/test_device_delete.cpp	28.57% <ø> (ø)
... and 30 more

... and 2365 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[Beanavil]

Build jobs are currently failing because libhipcxx seems to be missing from CI, but code should be fine for review

[amd-jmahovsky]

@Beanavil The changes to rocThust look very minor, about 30 lines total. This PR includes everything for CCCL 3.1, correct?

[Beanavil]

Closing in favor of the ported PR: #13083