Skip to content

stream info: add upstream connection id#17512

Merged
snowp merged 18 commits intomainfrom
stream-info-conn-id
Aug 5, 2021
Merged

stream info: add upstream connection id#17512
snowp merged 18 commits intomainfrom
stream-info-conn-id

Conversation

@junr03
Copy link
Member

@junr03 junr03 commented Jul 27, 2021

Commit Message: stream info - add upstream connection id
Additional Description: Envoy Mobile is interested in surfacing some information from Stream Info up to the client for analysis purposes. It is useful to understand what streams were multiplexed over the same upstream connection and Envoy's internal connection id can be used to tie this up.
Risk Level:
Testing: pending

Signed-off-by: Jose Nino jnino@lyft.com

Jose Nino added 2 commits July 27, 2021 14:11
wip
Signed-off-by: Jose Nino <jnino@lyft.com>
wip
Signed-off-by: Jose Nino <jnino@lyft.com>
@repokitteh-read-only
Copy link

As a reminder, PRs marked as draft will not be automatically assigned reviewers,
or be handled by maintainer-oncall triage.

Please mark your PR as ready when you want it to be reviewed!

🐱

Caused by: #17512 was opened by junr03.

see: more, trace.

@junr03
Copy link
Member Author

junr03 commented Jul 27, 2021

@alyssawilk, this came out of a discussion our team had about being able to correlate stream behavior grouped by underlying upstream connection.

I wanted to put a draft up to discuss were and when to get this data. It looks to me from the existing behavior in the code here: d5b6e79#diff-b61a05a18225decb27f5620aefda1646c259e314547a7d985c369f62a684c12bR420

that the upstream connection populates its "downstream" side because the codec client (and the underlying connection) could be either downstream or upstream. So my first question to your is if this PR should support both upstream and downstream connection IDs, and fill only downstream when only a single direction makes sense.

Ultimately all I want is for the stream info to have access to the upstream connection id, and this seemed like the cleanest way to do so. However, I am not tied to this being the best way to obtain this information.

cc @goaway

Jose Nino added 3 commits July 27, 2021 16:35
Signed-off-by: Jose Nino <jnino@lyft.com>
Signed-off-by: Jose Nino <jnino@lyft.com>
fmt
Signed-off-by: Jose Nino <jnino@lyft.com>
Copy link
Contributor

@alyssawilk alyssawilk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, this sounds reasonable to me.
@mattklein123 @RyanTheOptimist for any other thoughts

Jose Nino added 2 commits July 30, 2021 15:14
Signed-off-by: Jose Nino <jnino@lyft.com>
fmt
Signed-off-by: Jose Nino <jnino@lyft.com>
@junr03 junr03 marked this pull request as ready for review July 30, 2021 22:20
Jose Nino added 2 commits August 2, 2021 12:17
Signed-off-by: Jose Nino <jnino@lyft.com>
Signed-off-by: Jose Nino <jnino@lyft.com>
@junr03
Copy link
Member Author

junr03 commented Aug 2, 2021

@alyssawilk updated!

mattklein123
mattklein123 previously approved these changes Aug 2, 2021
Copy link
Member

@mattklein123 mattklein123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks LGTM at a high level. Will defer to @alyssawilk for further review.

@mattklein123 mattklein123 removed their assignment Aug 2, 2021
Copy link
Contributor

@alyssawilk alyssawilk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM modulo one comment request :-)

Signed-off-by: Jose Nino <jnino@lyft.com>
Jose Nino added 2 commits August 3, 2021 11:38
Signed-off-by: Jose Nino <jnino@lyft.com>
Signed-off-by: Jose Nino <jnino@lyft.com>
alyssawilk
alyssawilk previously approved these changes Aug 3, 2021
Signed-off-by: Jose Nino <jnino@lyft.com>
@junr03
Copy link
Member Author

junr03 commented Aug 3, 2021

@alyssawilk if you could re-stamp that would be great. I realized that there was more involved in cleaning up the connectionID function that used to exist. I'll clean it up in a subsequent PR, and rolled back the initial deletion.

Jose Nino added 2 commits August 4, 2021 10:40
Signed-off-by: Jose Nino <jnino@lyft.com>
fmt
Signed-off-by: Jose Nino <jnino@lyft.com>
@junr03
Copy link
Member Author

junr03 commented Aug 4, 2021

@alyssawilk @soulxu I have updated with @soulxu's recommendation. We should be good now

Jose Nino added 3 commits August 4, 2021 15:05
Signed-off-by: Jose Nino <jnino@lyft.com>
fmt
Signed-off-by: Jose Nino <jnino@lyft.com>
Signed-off-by: Jose Nino <jnino@lyft.com>
@soulxu
Copy link
Member

soulxu commented Aug 4, 2021

thanks for update! LGTM

@soulxu
Copy link
Member

soulxu commented Aug 5, 2021

/retest

@repokitteh-read-only
Copy link

Retrying Azure Pipelines:
Retried failed jobs in: envoy-presubmit

🐱

Caused by: a #17512 (comment) was created by @soulxu.

see: more, trace.

Copy link
Contributor

@snowp snowp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@snowp snowp merged commit 79ade4a into main Aug 5, 2021
baojr added a commit to baojr/envoy that referenced this pull request Aug 5, 2021
…bridge-stream

* upstream/main:
  stream info: add upstream connection id (envoyproxy#17512)
  runtime: removing require_ocsp_response_for_must_staple_certs (envoyproxy#17541)
  tooling: Fixes/cleanups/tests for `rst_checks.py` (envoyproxy#17589)
  Add a new HappyEyeballsConnectionImpl class (envoyproxy#17371)
  hcm/listener_manager: remove deprecated v2 config handling. (envoyproxy#17586)
  tools: simplify bazel deps query (envoyproxy#17599)
  tooling: Move tempdir/cleanup to base runner class (envoyproxy#17590)
  tools: fix missing format strings (envoyproxy#17600)
  tooling: Add `@envoy` prefix in `envoy_py_` macros (envoyproxy#17588)
  stream info: add attempt count for HTTP requests and TCP proxy (envoyproxy#17583)

Signed-off-by: Garrett Bourg <bourg@squareup.com>
@mattklein123 mattklein123 deleted the stream-info-conn-id branch August 9, 2021 15:03
leyao-daily pushed a commit to leyao-daily/envoy that referenced this pull request Sep 30, 2021
Signed-off-by: Jose Nino <jnino@lyft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants