Skip to content

UCP/RNDV: Fix in mem type pipeline - #6614

Merged
yosefe merged 1 commit into
openucx:masterfrom
bureddy:fix-cuda-pipeline
Apr 14, 2021
Merged

yosefe merged 1 commit into
openucx:masterfrom
bureddy:fix-cuda-pipeline

Conversation

@bureddy

@bureddy bureddy commented Apr 6, 2021

Copy link
Copy Markdown
Contributor

What

regression from #6208
cuda_copy ZCOPY is ignored on self endpoint because addr info is not sent because key md_map is empty.

How ?

Revert #6208
Instead of deriving the scenarios by whether the address is passed or not in the RTS, pass the memory type of source address in the RTS to make the decisions at the receiver.

@bureddy
bureddy force-pushed the fix-cuda-pipeline branch 2 times, most recently from d441fe9 to 1b4b0ca Compare April 6, 2021 20:27
Comment thread src/ucp/rndv/rndv.h Outdated
ucp_request_hdr_t sreq; /* send request on the rndv initiator side */
uint64_t address; /* holds the address of the data buffer on the sender's side */
size_t size; /* size of the data for sending */
uint8_t mem_type; /* memory type */

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we cannot change RTS header because it will break wire compatibility
need to take mem_type from unpacked remote key

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@yosefe fixed. can you please review it?

Comment thread src/ucp/rndv/rndv.c Outdated
}

if (!is_get_zcopy_failed) {
if (!is_get_zcopy_failed || UCP_MEM_IS_GPU(rndv_rts_hdr->mem_type)) {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why do always need to register recv buffer in case get_zcopy failed? pls add/update the below comment

@bureddy
bureddy force-pushed the fix-cuda-pipeline branch 2 times, most recently from 7ad6eb2 to 1d4e18a Compare April 12, 2021 19:09
@bureddy
bureddy force-pushed the fix-cuda-pipeline branch from 1d4e18a to 884e7e2 Compare April 14, 2021 01:32
@yosefe
yosefe merged commit 42bafc1 into openucx:master Apr 14, 2021
@bureddy
bureddy deleted the fix-cuda-pipeline branch April 14, 2021 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants