Skip to content

Improve the example for the Kafka Broker filter#23044

Merged
phlax merged 5 commits intoenvoyproxy:mainfrom
adamkotwasinski:kafka-broker-example
Sep 16, 2022
Merged

Improve the example for the Kafka Broker filter#23044
phlax merged 5 commits intoenvoyproxy:mainfrom
adamkotwasinski:kafka-broker-example

Conversation

@adamkotwasinski
Copy link
Copy Markdown
Contributor

Commit Message: Improve the example for the Kafka Broker filter
Additional Description: Makes the client traffic actually go through Envoy
Risk Level: Low
Testing: README.md guideline
Docs Changes: N/A
Release Notes: N/A
Platform Specific Features: N/A

Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

adamkotwasinski commented Sep 8, 2022

@nguyenptk @phlax Sorry it took so long (back from holidays). There was a small mis-config in Confluent Docker image that made the traffic reach the "internal" Kafka server socket, making the connections work (surprising) but the follow-up traffic actually went client <-> Kafka, instead of client <-> Envoy <-> Kafka. This PR should fix that and we finally got the metrics (like the create_topics one).

@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

/review @phlax @nguyenptk

@repokitteh-read-only
Copy link
Copy Markdown

@nguyenptk cannot be assigned as a reviewer to this issue.

🐱

Caused by: a #23044 (comment) was created by @adamkotwasinski.

see: more, trace.

@adamkotwasinski adamkotwasinski marked this pull request as draft September 9, 2022 00:36
@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

(just realized there's a verify check I need to amend a little)

kafka.kafka_broker.response.find_coordinator_response: 1
kafka.kafka_broker.response.metadata_response: 4
$ curl -s "http://localhost:8001/stats?filter=kafka.kafka_broker" | grep -v ": 0" | grep "_request:"
kafka.kafka_broker.request.api_versions_request: 9
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We also need to update the verify.sh to fix the pipeline's error here

> [kafka] Check admin kafka_broker stats
ERROR: curl (http://localhost:11101/stats?filter=kafka.kafka_broker.request.api_versions_request)
EXPECTED: kafka.kafka_broker.request.api_versions_request: 4
RECEIVED:
kafka.kafka_broker.request.api_versions_request: 9

Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
Signed-off-by: Adam Kotwasinski <adam.kotwasinski@gmail.com>
@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

/retest

@repokitteh-read-only
Copy link
Copy Markdown

Retrying Azure Pipelines:
Check envoy-presubmit isn't fully completed, but will still attempt retrying.
Retried failed jobs in: envoy-presubmit

🐱

Caused by: a #23044 (comment) was created by @adamkotwasinski.

see: more, trace.

@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

/retest

@repokitteh-read-only
Copy link
Copy Markdown

Retrying Azure Pipelines:
Retried failed jobs in: envoy-presubmit

🐱

Caused by: a #23044 (comment) was created by @adamkotwasinski.

see: more, trace.

@adamkotwasinski adamkotwasinski marked this pull request as ready for review September 10, 2022 23:03
@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

/review @phlax

@adamkotwasinski adamkotwasinski requested review from nguyenptk and removed request for phlax September 10, 2022 23:03
@adamkotwasinski
Copy link
Copy Markdown
Contributor Author

/review @phlax

@repokitteh-read-only repokitteh-read-only Bot requested review from phlax and removed request for nguyenptk September 10, 2022 23:04
Copy link
Copy Markdown
Member

@phlax phlax left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, thanks @adamkotwasinski for cleaning this up

@phlax phlax merged commit fc25cc6 into envoyproxy:main Sep 16, 2022
@adamkotwasinski adamkotwasinski deleted the kafka-broker-example branch September 16, 2022 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants