Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
22 commits
Select commit Hold shift + click to select a range
41d27df
Fix the parquet io utils
mhaseeb123 May 15, 2026
dbbdea2
Remove unnecessary comments
mhaseeb123 May 15, 2026
5a95c7e
Remove unnecessary sync
mhaseeb123 May 15, 2026
410d495
Minor updates
mhaseeb123 May 15, 2026
96e1778
Minor update
mhaseeb123 May 15, 2026
7ae60be
Minor improvement
mhaseeb123 May 18, 2026
0008932
Merge branch 'release/26.06' into fix/parquet-io-utils-stream
mhaseeb123 May 18, 2026
f552803
Optimize parquet io utils
mhaseeb123 May 18, 2026
da4c404
Add and use multisource parquet io utils
mhaseeb123 May 18, 2026
7b000c5
Merge branch 'main' of https://github.com/rapidsai/cudf into fea/mult…
mhaseeb123 May 19, 2026
683acc9
Minor variable name improvement
mhaseeb123 May 20, 2026
407ef0d
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 May 22, 2026
a7928f1
Update
mhaseeb123 May 22, 2026
bfbd7e1
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 May 25, 2026
ca2e3f8
Update cpp/src/io/parquet/io_utils/parquet_io_utils.cpp
mhaseeb123 May 26, 2026
fc055b1
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 Jun 1, 2026
867341e
Update cpp/src/io/parquet/io_utils/parquet_io_utils.cpp
mhaseeb123 Jun 1, 2026
a2c4f0c
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 Jun 2, 2026
72b579f
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 Jun 2, 2026
3a56e67
Address comments
mhaseeb123 Jun 2, 2026
72d5da9
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 Jun 2, 2026
78d2bb4
Merge branch 'main' into fea/multi-source-parquet-io-utils
mhaseeb123 Jun 2, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
22 changes: 22 additions & 0 deletions cpp/include/cudf/io/parquet_io_utils.hpp
Original file line number Diff line number Diff line change
Expand Up @@ -109,6 +109,28 @@ fetch_byte_ranges_to_device_async(cudf::io::datasource& datasource,
rmm::cuda_stream_view stream,
rmm::device_async_resource_ref mr);

/**
* @brief Fetches lists of byte ranges from multiple datasources into device buffers
*
* @ingroup io_utils
*
* @param datasources Input datasources
* @param byte_ranges_per_source Vector of byte ranges to fetch, one per datasource
* @param stream CUDA stream
* @param mr Device memory resource
*
* @return A tuple containing a vector of device buffers, a vector of vectors of device spans (one
* per byte range per datasource), and a future to wait on the read tasks
*/
std::tuple<std::vector<rmm::device_buffer>,
std::vector<std::vector<cudf::device_span<uint8_t const>>>,
std::future<void>>
fetch_byte_ranges_to_device_async(
cudf::host_span<std::reference_wrapper<cudf::io::datasource> const> datasources,
cudf::host_span<std::vector<byte_range_info> const> byte_ranges_per_source,
rmm::cuda_stream_view stream,
rmm::device_async_resource_ref mr);

/** @} */ // end of group
} // namespace io::parquet
} // namespace CUDF_EXPORT cudf
Loading
Loading