-
Notifications
You must be signed in to change notification settings - Fork 4.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bulk load CDK: test refactors #48488
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 1 Skipped Deployment
|
@@ -0,0 +1 @@ | |||
testExecutionConcurrency=-1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't understand what changed, but this used to not be necessary https://airbytehq-team.slack.com/archives/C06E6CQMDT3/p1731520778573749
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Did we upgrade gradle?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
🤷 I didn't bother digging into the commit history for this, the workaround is easy enough
2a18eb5
to
b4ae32f
Compare
@@ -19,13 +20,19 @@ import java.math.BigInteger | |||
import java.nio.ByteBuffer | |||
|
|||
object Jsons : ObjectMapper() { | |||
// allow jackson to deserialize anything under 100 MiB | |||
// (the default, at time of writing 2024-05-29, with jackson 2.15.2, is 20 MiB) | |||
private const val JSON_MAX_LENGTH = 100 * 1024 * 1024 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this diff is just matching our existing behavior from
airbyte/airbyte-cdk/java/airbyte-cdk/dependencies/src/main/kotlin/io/airbyte/commons/json/Jsons.kt
Line 34 in 712ea82
private const val JSON_MAX_LENGTH = 100 * 1024 * 1024 |
(it's also needed to make the float-handling test work)
...bulk/toolkits/load-parquet/src/main/kotlin/io/airbyte/cdk/load/file/parquet/ParquetWriter.kt
Show resolved
Hide resolved
...-cdk/bulk/core/load/src/testFixtures/kotlin/io/airbyte/cdk/load/test/util/IntegrationTest.kt
Show resolved
Hide resolved
7af7f37
to
ad4a14c
Compare
bbe5444
to
2c4d189
Compare
core/base changes LGTM |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm (can't approve b/c I opened the pr 😓 )
3058730
to
a204cff
Compare
e6882ff
to
27b6f5e
Compare
27b6f5e
to
e66380f
Compare
526c3a8
to
0daa8e1
Compare
Co-authored-by: Johnny Schmidt <[email protected]>
just look at the commits individually, they're hopefully organized in a reasonable way.