Skip to content

Update cloudwatch query for table summary stats job#12289

Merged
sb-2011 merged 1 commit intomainfrom
1041-cloudwatch-stale-data-check
Jul 1, 2025
Merged

Update cloudwatch query for table summary stats job#12289
sb-2011 merged 1 commit intomainfrom
1041-cloudwatch-stale-data-check

Conversation

@sb-2011
Copy link
Contributor

@sb-2011 sb-2011 commented Jun 25, 2025

changelog: Internal, DataWarehouse Alerts, Update the TableSummaryStatsExportJob cloudwatch query to exclude duplicate messages (Issue 1041)

Related MRs:

🎫 Ticket

issue-1041

🛠 Summary of changes

Update the cloudwatch query to exclude generic duplicate logs that are dedupped as they flow into Redshift so that we can ensure parity when the stale data check runs.

📜 Testing Plan

  • Step 1: Deploy to personal env
  • Step 2: Run the entire stale data check workflow and confirm that the cloudwatch row count check passes

@sb-2011 sb-2011 force-pushed the 1041-cloudwatch-stale-data-check branch 2 times, most recently from 91a8f5c to c08e61b Compare July 1, 2025 00:02
changelog: Internal, DataWarehouse Alerts, Update the TableSummaryStatsExportJob cloudwatch query to exclude duplicate messages (Issue 1041)
@sb-2011 sb-2011 force-pushed the 1041-cloudwatch-stale-data-check branch from c08e61b to ec1829c Compare July 1, 2025 13:46
@sb-2011 sb-2011 merged commit d2f4243 into main Jul 1, 2025
1 check passed
@sb-2011 sb-2011 deleted the 1041-cloudwatch-stale-data-check branch July 1, 2025 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants