Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Super pipeline KFPv2. #488

Merged
merged 11 commits into from
Aug 19, 2024
Merged

Super pipeline KFPv2. #488

merged 11 commits into from
Aug 19, 2024

Conversation

Mohammad-nassar10
Copy link
Collaborator

Why are these changes needed?

Related issue number (if any).

Signed-off-by: Mohammad Nassar <[email protected]>
@Mohammad-nassar10 Mohammad-nassar10 marked this pull request as draft August 8, 2024 07:32
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
@Mohammad-nassar10 Mohammad-nassar10 marked this pull request as ready for review August 12, 2024 08:29
- It is not required to upload the transforms pipelines before running the superpipeline.
- It created just one run that includes all the nested transfroms and their sub-tasks.
- No need for additional component as `executeSubWorkflowComponent.yaml`. All the implementation in the same pipeline file.
- One missing thing in this implementation is the overriding parameters option.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

From here it is not clear what do you mean

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this sentence better:
In superpipelines of KFP v1 there exists an option to override the common parameters with specific values for each one of the transforms. This option is missing in the KFP v2 superpipelines.

![json_param](json_param.png)

## Main differences from KFP v1 superpipeline:
- It is not required to upload the transforms pipelines before running the superpipeline.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe to add that the entire pipeline and the nested pipelines are up to date.

Signed-off-by: Mohammad Nassar <[email protected]>
@roytman roytman merged commit c8756e3 into IBM:dev Aug 19, 2024
21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants