Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Serve] Support gRPC stream to stream request response #42488

Open
GeneDer opened this issue Jan 18, 2024 · 1 comment
Open

[Serve] Support gRPC stream to stream request response #42488

GeneDer opened this issue Jan 18, 2024 · 1 comment
Assignees
@GeneDer
Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue

Comments

@GeneDer
Copy link
Contributor

GeneDer commented Jan 18, 2024

Description

right now Serve's gRPC only supports unary-unary and unary-stream request response. Let's add support to stream-stream request response.

Re: https://discuss.ray.io/t/serve-high-stream-to-stream-grpc-methods-do-not-work/13459

Use case

No response
@GeneDer GeneDer added enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks labels Jan 18, 2024
@GeneDer GeneDer self-assigned this Jan 18, 2024
@psydok psydok mentioned this issue Jan 19, 2024
Closed
@anyscalesam anyscalesam added the serve Ray Serve Related Issue label Jun 21, 2024
@greaber
Copy link

greaber commented Dec 20, 2024

Is this on the road map?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@GeneDer GeneDer

Labels
enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks serve Ray Serve Related Issue
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@GeneDer @greaber @anyscalesam