-
Notifications
You must be signed in to change notification settings - Fork 135
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Super pipeline KFPv2. #488
Conversation
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
Signed-off-by: Mohammad Nassar <[email protected]>
- It is not required to upload the transforms pipelines before running the superpipeline. | ||
- It created just one run that includes all the nested transfroms and their sub-tasks. | ||
- No need for additional component as `executeSubWorkflowComponent.yaml`. All the implementation in the same pipeline file. | ||
- One missing thing in this implementation is the overriding parameters option. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
From here it is not clear what do you mean
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is this sentence better:
In superpipelines of KFP v1 there exists an option to override the common parameters with specific values for each one of the transforms. This option is missing in the KFP v2 superpipelines.
![json_param](json_param.png) | ||
|
||
## Main differences from KFP v1 superpipeline: | ||
- It is not required to upload the transforms pipelines before running the superpipeline. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
maybe to add that the entire pipeline and the nested pipelines are up to date.
Signed-off-by: Mohammad Nassar <[email protected]>
Why are these changes needed?
Related issue number (if any).