Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MaxMessageSize too low for Cloud Pub/Sub #1499

Closed
mdietz94 opened this issue Jan 4, 2017 · 11 comments
Closed

MaxMessageSize too low for Cloud Pub/Sub #1499

mdietz94 opened this issue Jan 4, 2017 · 11 comments
Assignees
Labels
api: pubsub Issues related to the Pub/Sub API.

Comments

@mdietz94
Copy link

mdietz94 commented Jan 4, 2017

Cloud Pub/Sub allows responses of up to 20 MB, so the channel default of 4 MB causes deframing errors for users, as can be seen here https://code.google.com/p/cloud-pubsub/issues/detail?id=50 . MaxMessageSize should either be increased to at least 20 MB, or else users should be given the ability to change it themselves.

@garrettjonesgoogle
Copy link
Member

@pongad : I'm unsure if this is already addressed in the pubsub-hp branch.

@pongad
Copy link
Contributor

pongad commented Jan 26, 2017

This issue seems to be alleviated by grpc/grpc-java#2307 . As of GRPC 1.0.3 though, the fix hasn't been merged...

@pongad
Copy link
Contributor

pongad commented Feb 27, 2017

@garrettjonesgoogle This is now available here. It is marked experimental though. Are we OK to use this? I'm a little worried about ABI compatibility with later releases. Or do we plan to shade the entire gRPC?

@garrettjonesgoogle
Copy link
Member

Good catch. I'm trying to get away from dependencies on experimental features. We will need to think about this.

@garrettjonesgoogle
Copy link
Member

Filed issue grpc/grpc-java#2763 .

@garrettjonesgoogle
Copy link
Member

Maybe we could mark it as experimental on our own surface too, so that users can make their own choice about whether to depend on it.

@garrettjonesgoogle
Copy link
Member

Hmm ideally we wouldn't actually want to expose this on our surface, since this can be completely determined by which API is in use.

@garrettjonesgoogle
Copy link
Member

@pongad - GAX issue: googleapis/gax-java#149 - please resolve that issue if for some reason no GAX change is necessary to support Pub/Sub.

@pongad
Copy link
Contributor

pongad commented Mar 31, 2017

@mdietz94 Sorry it took me so long to get to this. I want to make sure. This is only for Subscriber right? The Publisher is unaffected?

@mdietz94
Copy link
Author

Yes, this is only inbound message size, so this only affects Subscriber.

@garrettjonesgoogle
Copy link
Member

This has been fixed for a while. #1911 moved the grpc call into GAX, so that it's no longer made directly from google-cloud-java. Resolving.

github-actions bot pushed a commit that referenced this issue Oct 4, 2022
🤖 I have created a release *beep* *boop*
---


## [2.3.15](https://github.com/googleapis/java-bigquerydatatransfer/compare/v2.3.14...v2.3.15) (2022-10-03)


### Dependencies

* Update dependency cachetools to v5 ([#1511](https://github.com/googleapis/java-bigquerydatatransfer/issues/1511)) ([b95ccc8](https://github.com/googleapis/java-bigquerydatatransfer/commit/b95ccc8d07c7fc5b6f50917560304bf7d1db8b02))
* Update dependency certifi to v2022.9.24 ([#1497](https://github.com/googleapis/java-bigquerydatatransfer/issues/1497)) ([8280ad9](https://github.com/googleapis/java-bigquerydatatransfer/commit/8280ad9d94f44c41dbc57aef7007359fa43a65ec))
* Update dependency charset-normalizer to v2.1.1 ([#1501](https://github.com/googleapis/java-bigquerydatatransfer/issues/1501)) ([7f61538](https://github.com/googleapis/java-bigquerydatatransfer/commit/7f6153862f189554d10b82b755dcccb9f24c3044))
* Update dependency click to v8.1.3 ([#1502](https://github.com/googleapis/java-bigquerydatatransfer/issues/1502)) ([d315f8e](https://github.com/googleapis/java-bigquerydatatransfer/commit/d315f8e433a64f1a1e4673688991b807285f5435))
* Update dependency com.google.cloud:google-cloud-shared-dependencies to v3.0.4 ([#1523](https://github.com/googleapis/java-bigquerydatatransfer/issues/1523)) ([5eb622d](https://github.com/googleapis/java-bigquerydatatransfer/commit/5eb622d8bcf05a9852c342a73d119e4d703a0c27))
* Update dependency com.google.protobuf:protobuf-java-util to v3.21.7 ([#1521](https://github.com/googleapis/java-bigquerydatatransfer/issues/1521)) ([7bb94b7](https://github.com/googleapis/java-bigquerydatatransfer/commit/7bb94b735d7822337f5f6b671b425081f4822813))
* Update dependency gcp-releasetool to v1.8.8 ([#1498](https://github.com/googleapis/java-bigquerydatatransfer/issues/1498)) ([9801601](https://github.com/googleapis/java-bigquerydatatransfer/commit/9801601eacc79432efa9ce243af8bda87bdeadb2))
* Update dependency google-cloud-core to v2.3.2 ([#1499](https://github.com/googleapis/java-bigquerydatatransfer/issues/1499)) ([1e73bff](https://github.com/googleapis/java-bigquerydatatransfer/commit/1e73bfffe09f8ae7f5216e8e4cd3e7d4aa520893))
* Update dependency googleapis-common-protos to v1.56.4 ([#1500](https://github.com/googleapis/java-bigquerydatatransfer/issues/1500)) ([3b4b24c](https://github.com/googleapis/java-bigquerydatatransfer/commit/3b4b24ccff9a199f78c8e48ea73e7c04f4e2bb5e))
* Update dependency jinja2 to v3.1.2 ([#1503](https://github.com/googleapis/java-bigquerydatatransfer/issues/1503)) ([4864061](https://github.com/googleapis/java-bigquerydatatransfer/commit/48640616122833134b28e42bc689109849a77279))
* Update dependency keyring to v23.9.3 ([#1504](https://github.com/googleapis/java-bigquerydatatransfer/issues/1504)) ([cc523de](https://github.com/googleapis/java-bigquerydatatransfer/commit/cc523de50fefe993dbfbedbebbbd5a9754071342))
* Update dependency markupsafe to v2.1.1 ([#1505](https://github.com/googleapis/java-bigquerydatatransfer/issues/1505)) ([1e0ba5e](https://github.com/googleapis/java-bigquerydatatransfer/commit/1e0ba5e094f98858affb53f77ceb61eff677b7cd))
* Update dependency protobuf to v3.20.2 ([#1506](https://github.com/googleapis/java-bigquerydatatransfer/issues/1506)) ([7a1e267](https://github.com/googleapis/java-bigquerydatatransfer/commit/7a1e267ce2a02b9c506769de09bfefc76d103cb8))
* Update dependency protobuf to v4 ([#1512](https://github.com/googleapis/java-bigquerydatatransfer/issues/1512)) ([12c0c67](https://github.com/googleapis/java-bigquerydatatransfer/commit/12c0c67819a05f4bafab1c280fd3a8b15ee0193b))
* Update dependency pyjwt to v2.5.0 ([#1507](https://github.com/googleapis/java-bigquerydatatransfer/issues/1507)) ([98f2d58](https://github.com/googleapis/java-bigquerydatatransfer/commit/98f2d580e1a78aeeebbbc5db8d2b99461255b86f))
* Update dependency requests to v2.28.1 ([#1508](https://github.com/googleapis/java-bigquerydatatransfer/issues/1508)) ([9906ca8](https://github.com/googleapis/java-bigquerydatatransfer/commit/9906ca8c8a67390106b524d561f1e973126aecfa))
* Update dependency typing-extensions to v4.3.0 ([#1509](https://github.com/googleapis/java-bigquerydatatransfer/issues/1509)) ([2d7eb9f](https://github.com/googleapis/java-bigquerydatatransfer/commit/2d7eb9f93181fbf183ae2d633fdc63748c82110e))
* Update dependency zipp to v3.8.1 ([#1510](https://github.com/googleapis/java-bigquerydatatransfer/issues/1510)) ([dd98eef](https://github.com/googleapis/java-bigquerydatatransfer/commit/dd98eef23cdbac8b9c365504c2456776bed786a9))

---
This PR was generated with [Release Please](https://github.com/googleapis/release-please). See [documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: pubsub Issues related to the Pub/Sub API.
Projects
None yet
Development

No branches or pull requests

3 participants