Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Merged by Bors] - Fix processing of log events in Vector #452

Closed
wants to merge 8 commits into from

Conversation

siegfriedweber
Copy link
Member

@siegfriedweber siegfriedweber commented Apr 7, 2023

Description

  • Avoid empty log events dated to 1970-01-01 and improve the precision of the log event timestamps.
  • Add a test case to detect invalid log events
  • Make the logging tests independent of the availability of the upstream Vector aggregator.

Integration tests

https://ci.stackable.tech/view/02%20Operator%20Tests%20(custom)/job/nifi-operator-it-custom/30/

Definition of Done Checklist

  • Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant
  • Please make sure all these things are done and tick the boxes

Author

Preview Give feedback

Reviewer

Preview Give feedback

Acceptance

Preview Give feedback

Once the review is done, comment bors r+ (or bors merge) to merge. Further information

@siegfriedweber siegfriedweber marked this pull request as ready for review April 7, 2023 14:48
Copy link
Member

@maltesander maltesander left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No 1970 timestamps but i found some broken logs:

nifi-log1
nifi-log2

And the operator throws an apply error for the reporting task (i think not related to this PR):

2023-04-10T15:46:25.281021Z ERROR stackable_operator::logging::controller: Failed to reconcile object controller.name="nificluster.nifi.stackable.tech" error=reconciler for object NifiCluster.v1alpha1.nifi.stackable.tech/test-nifi.
default failed error.sources=[failed to apply create ReportingTask job, Kubernetes reported error: ApiError: Job.batch "test-nifi-create-reporting-task-1-18-0" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMe
ta:v1.ObjectMeta{Name:"test-nifi-create-reporting-task-1-18-0", GenerateName:"" ...  field is immutable: Invalid]

bors bot pushed a commit that referenced this pull request Apr 12, 2023
# Description

Fixes bugs found in #452 such as
```
2023-04-10T15:46:25.281021Z ERROR stackable_operator::logging::controller: Failed to reconcile object controller.name="nificluster.nifi.stackable.tech" error=reconciler for object NifiCluster.v1alpha1.nifi.stackable.tech/test-nifi.
default failed error.sources=[failed to apply create ReportingTask job, Kubernetes reported error: ApiError: Job.batch "test-nifi-create-reporting-task-1-18-0" is invalid: spec.template: Invalid value: core.PodTemplateSpec{ObjectMe
ta:v1.ObjectMeta{Name:"test-nifi-create-reporting-task-1-18-0", GenerateName:"" ...  field is immutable: Invalid]
```



Co-authored-by: Malte Sander <[email protected]>
# Conflicts:
#	CHANGELOG.md
#	rust/operator-binary/src/controller.rs
Copy link
Member

@maltesander maltesander left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bors merge

bors bot pushed a commit that referenced this pull request Apr 13, 2023
# Description

- Avoid empty log events dated to 1970-01-01 and improve the precision of the log event timestamps.
- Add a test case to detect invalid log events
- Make the logging tests independent of the availability of the upstream Vector aggregator.



Co-authored-by: Malte Sander <[email protected]>
@bors
Copy link
Contributor

bors bot commented Apr 13, 2023

Pull request successfully merged into main.

Build succeeded:

@bors bors bot changed the title Fix processing of log events in Vector [Merged by Bors] - Fix processing of log events in Vector Apr 13, 2023
@bors bors bot closed this Apr 13, 2023
@bors bors bot deleted the fix-log-events branch April 13, 2023 15:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

4 participants