Skip to content

Bulk load CDK: destinationcleaner must be singleton#59137

Merged
Edward Gao (edgao) merged 8 commits intomasterfrom
edgao/actually_run_cleaner_once_per_instance
May 1, 2025
Merged

Bulk load CDK: destinationcleaner must be singleton#59137
Edward Gao (edgao) merged 8 commits intomasterfrom
edgao/actually_run_cleaner_once_per_instance

Conversation

@edgao
Copy link
Contributor

@edgao Edward Gao (edgao) commented Apr 28, 2025

closes https://github.com/airbytehq/airbyte-internal-issues/issues/12662

force the data cleaner to be a singleton, revert #58675 so that we run the cleaner exactly once per gradle invocation

and update s3datalake+mssql to be singleton

@vercel
Copy link

vercel bot commented Apr 28, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback May 1, 2025 6:52pm

@edgao
Copy link
Contributor Author

nope, everything still sucks, this only worked in mock test b/c the cleaner is an object instead of actually instanced

@edgao Edward Gao (edgao) force-pushed the edgao/actually_run_cleaner_once_per_instance branch from e867596 to 4b074d2 Compare April 29, 2025 16:46
@edgao Edward Gao (edgao) changed the title Bulk load CDK: fix destinaioncleaner to actually run once per instance Bulk load CDK: destinationcleaner must be singleton Apr 29, 2025
@edgao Edward Gao (edgao) marked this pull request as ready for review April 29, 2025 17:07
# Conflicts:
#	airbyte-integrations/connectors/destination-mssql/src/test-integration/kotlin/io/airbyte/integrations/destination/mssql/v2/MSSQLWriterTest.kt
@edgao Edward Gao (edgao) merged commit 03a52f7 into master May 1, 2025
29 checks passed
@edgao Edward Gao (edgao) deleted the edgao/actually_run_cleaner_once_per_instance branch May 1, 2025 19:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants