Skip to content

Conversation

stevesg
Copy link
Contributor

@stevesg stevesg commented Feb 22, 2021

What this PR does:
This change limits the effect of idle compaction to only create blocks
from the of samples which have reached a configurable age. This change
is make the way for allowing ingestion of samples concurrently with
compaction.

I'm putting this commit up as a draft for discussion - a second commit is
needed to actually enable the pushing. This commit only limits the
compaction range.

Which issue(s) this PR fixes:
Fixes #3832

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

This change limits the effect of idle compaction to only create blocks
from the of samples which have reached a configurable age. This change
is make the way for allowing ingestion of samples concurrently with
compaction (separate commit).

Signed-off-by: Steve Simpson <[email protected]>
Signed-off-by: Steve Simpson <[email protected]>
@pracucci
Copy link
Contributor

pracucci commented Mar 1, 2021

Should we close it for now, given we've tried to mitigate it with a jitter in #3850 ?

@stevesg
Copy link
Contributor Author

stevesg commented Mar 1, 2021

Yeah makes sense.

@stevesg stevesg closed this Mar 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Make TSDB idle-flush more dynamic by compacting only time range that cannot receive any samples.

2 participants