Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add initial flow aggregation code and API #9708

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

caseydavenport
Copy link
Member

Description

This PR introduces a new component responsible for ingesting, aggregating, and the servering flow log data from the individual felix daemons deployed in a Calico cluster. This is still an early sketch of the component, but the major functional pieces are in place so it's a good place to start.

It is made of a few parts:

  • a gRPC API with which each Felix is able to push flow log data to the aggregator.
  • an aggregator component, which groups / aggregates data from across the cluster into time-windowed buckets
  • a gRPC API which allows querying of the aggregated data
  • an HTTP emitter component, that emits further time-aggregated data to a configurable endpoint.

Related issues/PRs

Todos

  • Tests
  • Documentation
  • Release note

Release Note

TBD

Reminder for the reviewer

Make sure that this PR has the correct labels and milestone set.

Every PR needs one docs-* label.

  • docs-pr-required: This change requires a change to the documentation that has not been completed yet.
  • docs-completed: This change has all necessary documentation completed.
  • docs-not-required: This change has no user-facing impact and requires no docs.

Every PR needs one release-note-* label.

  • release-note-required: This PR has user-facing changes. Most PRs should have this label.
  • release-note-not-required: This PR has no user-facing changes.

Other optional labels:

  • cherry-pick-candidate: This PR should be cherry-picked to an earlier release. For bug fixes only.
  • needs-operator-pr: This PR is related to install and requires a corresponding change to the operator.

@caseydavenport caseydavenport requested a review from a team as a code owner January 13, 2025 21:21
@marvin-tigera marvin-tigera added this to the Calico v3.30.0 milestone Jan 13, 2025
@marvin-tigera marvin-tigera added release-note-required Change has user-facing impact (no matter how small) docs-pr-required Change is not yet documented labels Jan 13, 2025
@caseydavenport caseydavenport marked this pull request as draft January 13, 2025 21:21
@caseydavenport caseydavenport changed the title Add initial flow log aggregation code Add initial flow aggregation code Jan 13, 2025
@caseydavenport caseydavenport changed the title Add initial flow aggregation code Add initial flow aggregation code and API Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs-pr-required Change is not yet documented release-note-required Change has user-facing impact (no matter how small)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants