ci: run the RFC 0019 localstack S3 tests in the s3-integration job - #300
Conversation
The s3-integration job's --exact list was pinned to the original four RFC 0013 tests, so the Store-migration localstack tests added since (querier/compactor/ audit Store listing/delete/CAS/audit-sink) compiled but never actually ran in CI. Add the six new ones to the list (still --exact, so the deferred rfc0013_8 todo! stub stays un-run). Also: fix a stale Writer::Poisoned message that still referenced a .parquet.tmp on disk (the writer went buffer-and-put in #294). Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: defaults Review profile: CHILL Plan: Pro Plus Run ID: 📒 Files selected for processing (2)
📝 WalkthroughWalkthroughThe CI CI and error message updates
Estimated code review effort🎯 1 (Trivial) | ⏱️ ~3 minutes Possibly related PRs
Poem
🚥 Pre-merge checks | ✅ 4 | ❌ 1❌ Failed checks (1 warning)
✅ Passed checks (4 passed)
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Pull request overview
This PR ensures the s3-integration (LocalStack) CI job actually runs the newer RFC 0019 S3 integration tests that were previously compiled but skipped due to the --exact allowlist only naming the original RFC 0013 tests. It also updates WriterError::Poisoned’s display text to match the current buffer-and-put writer implementation (no temp file is left on disk).
Changes:
- Expands the
s3-integrationjob’scargo test ... --ignored --exactallowlist to include six RFC 0019 Store-migration LocalStack tests. - Keeps the deferred
rfc0013_8_reader_forward_compat_over_storetodo!()stub excluded by continuing to use an explicit--exactlist. - Fixes the
WriterError::Poisonedmessage to reflect that the in-memory buffer is discarded and nothing is written to the store.
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
crates/ourios-parquet/src/writer.rs |
Updates WriterError::Poisoned’s Display message to match the buffer-and-put writer behavior. |
.github/workflows/ci.yml |
Adds the RFC 0019 LocalStack S3 integration tests to the s3-integration job’s explicit --exact test list. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
What
The
s3-integration(localstack) CI job's--exactlist was pinned to the original four RFC 0013 tests, so the localstack tests added across the RFC 0019 Store migration (#293/#294/#297/#299) compiled under--all-targetsbut never actually ran in CI. This adds the six new ones to the invocation:store_list_enumerates_keys_on_s3,store_list_common_prefixes_rolls_up_on_s3,store_list_with_sizes_reports_byte_lengths_on_s3,store_delete_blocking_removes_on_s3(Store listing/delete helpers)compact_partition_consolidates_on_s3_via_cas(compactionpublish_cas)parquet_audit_sink_persists_to_s3(audit sink on S3)Still
--exact(not bare--ignored) so the deferredrfc0013_8_reader_forward_compat_over_storetodo!()stub stays un-run.Also folds in a one-line doc fix:
WriterError::Poisoned's message still said "the .parquet.tmp is preserved on disk", stale since #294 made the writer buffer-and-put (the buffer is now discarded; nothing is put).Why
De-risks RFC 0019 slice 3: this PR's own
s3 integration (localstack)run is the first time those six localstack tests execute in CI, validating the Store-migration harness end-to-end on realAmazonS3(localstack) before the server-level e2e tests build on it.Tests
No new tests — wires existing
#[ignore]d ones into CI.cargo fmt --check,cargo clippy -p ourios-parquet --all-targets -D warnings, YAML parse — all green locally. The six tests run in this PR'ss3 integrationjob.🤖 Generated with Claude Code
Summary by CodeRabbit
Bug Fixes
Tests