Skip to content

Heartbeat processor fixes and tweaks #1050

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 5 commits into from
Jan 31, 2025
Merged

Heartbeat processor fixes and tweaks #1050

merged 5 commits into from
Jan 31, 2025

Conversation

@tizoc
Copy link
Collaborator

@tizoc tizoc commented Jan 31, 2025 •
edited
Loading

  • More reporting
  • Use the window start as the lower bound for queries when the local database is first instantiated
  • Process fetched chunks more eagerly
  • Fix heartbeats fetch ordering, was causing some heartbeats to be lost in large batches

@tizoc tizoc force-pushed the feat/heartbeat-processor-tweaks branch 3 times, most recently from daccb61 to 51b1401 Compare January 31, 2025 15:18
tizoc added 5 commits January 31, 2025 12:18
@tizoc
fix(heartbeats): Use start window as first point of reference the fir…
7f1a726 
…st time
@tizoc
fix(heartbeats): Fix query order, should be ascending
18b793a
@tizoc
feat(heartbeats): Improved reporting
05a0eac 
- Report when a block could not be parsed
- Report more details for duplicated blocks
- Improve reporting of duplicates
@tizoc
feat(heartbeats): Process chunks as soon as we have them
aaf4192 
This change processes chunks as soon as they are received,
rather than waiting for the entire chunk to be received before processing it.
This helps the case where the processing starts from scratch and
there are lots of heartbeats ready to be processed.
@tizoc
feat(heartbeats): Update .sqlx files
e8ebe6e
@tizoc tizoc force-pushed the feat/heartbeat-processor-tweaks branch from 51b1401 to e8ebe6e Compare January 31, 2025 15:19
@tizoc tizoc merged commit 9819090 into develop Jan 31, 2025
1 check passed
@tizoc tizoc deleted the feat/heartbeat-processor-tweaks branch January 31, 2025 15:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@tizoc