Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(backend): implement subdag output resolution #11196

Merged
merged 19 commits into from
Oct 31, 2024
Merged

feat(backend): implement subdag output resolution #11196

merged 19 commits into from
Oct 31, 2024

Commits on Oct 21, 2024

  1. fix(backend): implement subdag output resolution 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
Co-authored-by: CarterFendley <[email protected]>
    @droctothorpe @zazulam @CarterFendley
    3 people committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b1da706 View commit details
    Browse the repository at this point in the history

  2. Add support for subdags of subdags 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
Co-authored-by: CarterFendley <[email protected]>
    @droctothorpe @zazulam @CarterFendley
    3 people committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    4c5d97e View commit details
    Browse the repository at this point in the history

  3. handle edge case 

    Signed-off-by: zazulam <[email protected]>
Co-authored-by: droctothorpe <[email protected]>
    @zazulam @droctothorpe
    zazulam and droctothorpe committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    5235a84 View commit details
    Browse the repository at this point in the history

  4. Handle artifact outputs as well 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
Co-authored-by: CarterFendley <[email protected]>
Co-authored-by: edmondop <[email protected]>
    @droctothorpe @zazulam
    @CarterFendley @edmondop
    4 people committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    1cefad2 View commit details
    Browse the repository at this point in the history

  5. Simplify parameter handling logic 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
    @droctothorpe @zazulam
    droctothorpe and zazulam committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    87914ca View commit details
    Browse the repository at this point in the history

  6. Begin decomposition 

    Signed-off-by: droctothorpe <[email protected]>
    @droctothorpe
    droctothorpe committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    e3baa89 View commit details
    Browse the repository at this point in the history

  7. Add support for multiple artifacts and params 

    Signed-off-by: Tyler Kalbach <[email protected]>
    @boarder7395 @droctothorpe
    boarder7395 authored and droctothorpe committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    2958960 View commit details
    Browse the repository at this point in the history

  8. Implement large tests for subdagio 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
Co-authored-by: CarterFendley <[email protected]>
    @droctothorpe @zazulam @CarterFendley
    3 people committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    7c66a33 View commit details
    Browse the repository at this point in the history

  9. Address PR comments & handle oneof 

    Signed-off-by: zazulam <[email protected]>
Co-authored-by: droctothorpe <[email protected]>
    @zazulam @droctothorpe
    zazulam and droctothorpe committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    dd65ce1 View commit details
    Browse the repository at this point in the history

  10. update backend metadata client test 

    Signed-off-by: zazulam <[email protected]>
    @zazulam @droctothorpe
    zazulam authored and droctothorpe committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    d15884a View commit details
    Browse the repository at this point in the history

  11. Enable nested pipeline IO large tests in CI 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: CarterFendley <[email protected]>
Co-authored-by: zazulam <[email protected]>
    @droctothorpe @CarterFendley @zazulam
    3 people committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    93d1f3c View commit details
    Browse the repository at this point in the history

  12. Execute narrow lookup before broad task lookup 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
Co-authored-by: CarterFendley <[email protected]>
    @droctothorpe @zazulam @CarterFendley
    3 people committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    b8efd3c View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. reimplement getDAGTasks to address edge cases 

    Signed-off-by: zazulam <[email protected]>
Co-authored-by: droctothorpe <[email protected]>
    @zazulam @droctothorpe
    zazulam and droctothorpe committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    78beb55 View commit details
    Browse the repository at this point in the history

  2. handle parallelfor in getDAGTask 

    Signed-off-by: zazulam <[email protected]>
Co-authored-by: droctothorpe <[email protected]>
    @zazulam @droctothorpe
    zazulam and droctothorpe committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    0076a2d View commit details
    Browse the repository at this point in the history

  3. Check if iterationIndex is nil 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
    @droctothorpe @zazulam
    droctothorpe and zazulam committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    9127cc1 View commit details
    Browse the repository at this point in the history

  4. check iteration_count for parallel tasks 

    Signed-off-by: zazulam <[email protected]>
Co-authored-by: droctothorpe <[email protected]>
    @zazulam @droctothorpe
    zazulam and droctothorpe committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    9d9b578 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. update comment & disable v(4) logs 

    Signed-off-by: zazulam <[email protected]>
    @zazulam
    zazulam committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    704d349 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Address Chen's feedback 

    Signed-off-by: droctothorpe <[email protected]>
Co-authored-by: zazulam <[email protected]>
    @droctothorpe @zazulam
    droctothorpe and zazulam committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    4d14cfe View commit details
    Browse the repository at this point in the history

Commits on Oct 30, 2024

  1. Clarify comment 

    Signed-off-by: droctothorpe <[email protected]>
    @droctothorpe
    droctothorpe committed Oct 30, 2024
    Configuration menu
    Copy the full SHA
    17e0c5d View commit details
    Browse the repository at this point in the history