Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug] Subdag Statuses update incorrectly #11572

Closed
HumairAK opened this issue Jan 30, 2025 · 2 comments · Fixed by #11651
Closed

[bug] Subdag Statuses update incorrectly #11572

HumairAK opened this issue Jan 30, 2025 · 2 comments · Fixed by #11651
Assignees
Milestone

Comments

@HumairAK
Copy link
Collaborator

HumairAK commented Jan 30, 2025

When using any control flows that require subdags like loops, nested pipelines, etc. the statuses update as soon as the first task within the dag completes. This is incorrect behavior as it should only show loading icon while sub tasks within the dag are still running.

Environment

  • How do you deploy Kubeflow Pipelines (KFP)? standalone and multi-user

  • KFP version: 2.4

To find the version number, See version number shows on bottom of KFP UI left sidenav. -->

  • KFP SDK version: 2.11

Steps to reproduce

  • Use a simple dag pipeline like the following:
@dsl.component()
def fail():
    import sys
    sys.exit(1)

@dsl.component()
def hello_world():
    print("hellow_world")

@dsl.component()
def post_msg():
    print(f"this is a message")

@dsl.pipeline
def pipeline():
    post_msg_task = post_msg().set_caching_options(enable_caching=False)
    with dsl.ExitHandler(exit_task=post_msg_task):
        hello_task = hello_world().set_caching_options(enable_caching=False)
        fail_task = fail().set_caching_options(enable_caching=False)
        fail_task.after(hello_task)


compiler.Compiler().compile(
    pipeline_func=pipeline,
    package_path=__file__.replace('.py', '-v2.yaml'))

Or any other control flow that utilizes sub dags, i.e. loops, nested pipelines, exit handlers, etc.

Expected result

The subdag status should stay as loading until all tasks are completed.

Materials and reference

dag-status-behavior.webm

Labels

/area backend


Impacted by this bug? Give it a 👍.

@izuku-sds
Copy link

/assign

@HumairAK HumairAK changed the title [bug] <Bug Name> [bug] Subdag Statuses update incorrectly Feb 6, 2025
@HumairAK HumairAK added this to the KFP 2.5.0 milestone Feb 6, 2025
@HumairAK HumairAK moved this to In Progress in KFP 2.x Release Feb 6, 2025
@izuku-sds
Copy link

Hello @HumairAK , can you please mention exact steps you used to deploy kubeflow pipeline. I was trying to deploy it locally standalone and multi-user but got problem at last when trying to access ui page or dashboard.
I followed instructions .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
2 participants