Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Destination S3 V2: copy over legacy DATs, enable tests #48490

Draft
wants to merge 25 commits into
base: jschmidt/s3v2/issue-10732/staging-tests
Choose a base branch
from
Draft

Destination S3 V2: copy over legacy DATs, enable tests #48490

wants to merge 25 commits into from
+688 −120

Commits on Nov 25, 2024

  1. Bulk Load CDK: prefix search nonambiguous; filename uses wall time

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    6238141 View commit details
    Browse the repository at this point in the history

  2. copy over stream read constraints

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    f88da53 View commit details
    Browse the repository at this point in the history

  3. add option for null = unset

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    93b129e View commit details
    Browse the repository at this point in the history

  4. move container types to containerTypes

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    1455454 View commit details
    Browse the repository at this point in the history

  5. oops

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    19e6f13 View commit details
    Browse the repository at this point in the history

  6. fix nulls in parquet array

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    e80dc84 View commit details
    Browse the repository at this point in the history

  7. propagate nullability to avro array schema

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    a7763d0 View commit details
    Browse the repository at this point in the history

  8. fix avro data dumper

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    f7f83e0 View commit details
    Browse the repository at this point in the history

  9. improve float/int handling

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    fdbfc3c View commit details
    Browse the repository at this point in the history

  10. improve float/int handling

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    0913c63 View commit details
    Browse the repository at this point in the history

  11. fixed avro/parquet bigint

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    64efce0 View commit details
    Browse the repository at this point in the history

  12. csv flattened fixed; all non-disabled tests green

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    c4584c5 View commit details
    Browse the repository at this point in the history

  13. enabled remaining resume tests save 1; fixed: part no during truncate… 

    …, bad timestamps
    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    fb27615 View commit details
    Browse the repository at this point in the history

  14. failing unit tests

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    10a6900 View commit details
    Browse the repository at this point in the history

  15. tweaks

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    a6762e3 View commit details
    Browse the repository at this point in the history

  16. fixed failing unit test

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    c28a29c View commit details
    Browse the repository at this point in the history

  17. copy over legacy DATs + enable remaining tests

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    b97d7af View commit details
    Browse the repository at this point in the history

  18. fix image name

    @edgao @johnny-schmidt
    edgao authored and johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    491f47f View commit details
    Browse the repository at this point in the history

  19. json test fixes; s3 special chrs; spec tweak; empty streams; state re… 

    …fact
    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    4faadad View commit details
    Browse the repository at this point in the history

  20. Fix: global state hangs when one stream is empty

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    2556e6f View commit details
    Browse the repository at this point in the history

  21. fix: slash between path and file iff explicitly in config

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    5775fdc View commit details
    Browse the repository at this point in the history

  22. fix: null-tolerant trace.emittedAt

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    a33eab7 View commit details
    Browse the repository at this point in the history

  23. fix? treats state without type as global sort of? is this real

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    59807a1 View commit details
    Browse the repository at this point in the history

  24. fix? status type can be null too?

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    114a17d View commit details
    Browse the repository at this point in the history

  25. and the default compression is gzip apparently?

    @johnny-schmidt
    johnny-schmidt committed Nov 25, 2024
    Configuration menu
    Copy the full SHA
    e3f0bb4 View commit details
    Browse the repository at this point in the history