Skip to content

athena audit logs - delete from sqs#24967

Merged
tobiaszheller merged 2 commits intomasterfrom
tobiaszheller/auditevents-athena-delete-from-sqs
Apr 25, 2023
Merged

athena audit logs - delete from sqs#24967
tobiaszheller merged 2 commits intomasterfrom
tobiaszheller/auditevents-athena-delete-from-sqs

Conversation

@tobiaszheller
Copy link
Copy Markdown
Contributor

Part of https://github.com/gravitational/teleport.e/issues/894
RFD: https://github.com/gravitational/teleport/blob/master/rfd/0118-scalable-audit-logs.md

This PR add to athena audit log, delete from sqs aka "acknowledge".
Delete it done when parquet file was successfull written to s3.
If error is returned from delete, it means that we will retry those "NACK" messages in next batch, or they will go to dead-letter queue after couple of NACKs.

@github-actions github-actions Bot requested review from mdwn and nklaassen April 21, 2023 10:49
@github-actions github-actions Bot added audit-log Issues related to Teleports Audit Log size/md labels Apr 21, 2023
@tobiaszheller tobiaszheller force-pushed the tobiaszheller/auditevents-athena-sqs-parquets3 branch 3 times, most recently from 76deca5 to c052d8b Compare April 25, 2023 11:44
@tobiaszheller tobiaszheller force-pushed the tobiaszheller/auditevents-athena-delete-from-sqs branch from 68c6d23 to 8a8727b Compare April 25, 2023 11:58
Base automatically changed from tobiaszheller/auditevents-athena-sqs-parquets3 to master April 25, 2023 12:19
@tobiaszheller tobiaszheller force-pushed the tobiaszheller/auditevents-athena-delete-from-sqs branch from 8a8727b to 97c8945 Compare April 25, 2023 12:22
Comment thread lib/events/athena/consumer.go
Comment thread lib/events/athena/consumer_test.go
@public-teleport-github-review-bot public-teleport-github-review-bot Bot removed the request for review from nklaassen April 25, 2023 16:38
@tobiaszheller tobiaszheller added this pull request to the merge queue Apr 25, 2023
Merged via the queue into master with commit 1b34cef Apr 25, 2023
@tobiaszheller tobiaszheller deleted the tobiaszheller/auditevents-athena-delete-from-sqs branch April 25, 2023 17:19
@public-teleport-github-review-bot
Copy link
Copy Markdown

@tobiaszheller See the table below for backport results.

Branch Result
branch/v13 Failed

@public-teleport-github-review-bot
Copy link
Copy Markdown

@tobiaszheller See the table below for backport results.

Branch Result
branch/v13 Create PR

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

audit-log Issues related to Teleports Audit Log size/md

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants