Skip to content

rpc : refactor the RPC transport#21998

Merged
ggerganov merged 3 commits into
ggml-org:masterfrom
rgerganov:rpc-rdma-refactor
Apr 19, 2026
Merged

rpc : refactor the RPC transport#21998
ggerganov merged 3 commits into
ggml-org:masterfrom
rgerganov:rpc-rdma-refactor

Conversation

@rgerganov
Copy link
Copy Markdown
Member

Move all transport related code into a separate file and use the socket_t interface to hide all transport implementation details.

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.
@github-actions github-actions Bot added the ggml changes relating to the ggml tensor library for machine learning label Apr 16, 2026
@rgerganov
Copy link
Copy Markdown
Member Author

Did some testing on the DGX cluster and haven't find any regressions so far.
The change is ready for review.

@rgerganov rgerganov marked this pull request as ready for review April 17, 2026 08:52
@rgerganov rgerganov requested a review from a team as a code owner April 17, 2026 08:52
@rgerganov rgerganov self-assigned this Apr 17, 2026
@rgerganov rgerganov requested a review from ggerganov April 17, 2026 08:52
@ggerganov ggerganov added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label Apr 17, 2026
@ggerganov ggerganov merged commit 91fef95 into ggml-org:master Apr 19, 2026
46 of 50 checks passed
ArberSephirotheca pushed a commit to ArberSephirotheca/llama.cpp that referenced this pull request Apr 21, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Apr 23, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
rsenthilkumar6 pushed a commit to rsenthilkumar6/llama.cpp that referenced this pull request May 1, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
jimbothigpen pushed a commit to jimbothigpen/frankenturbo2 that referenced this pull request May 2, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
ljubomirj pushed a commit to ljubomirj/llama.cpp that referenced this pull request May 6, 2026
* rpc : refactor the RPC transport

Move all transport related code into a separate file and use the
socket_t interface to hide all transport implementation details.

* fix win32

* better socket_t construction
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants