Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(release): kfp-tekton 1.8 release patch and tekton 0.50.1 patch #1331

Merged
merged 1 commit into from
Aug 22, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
# - The help target was derived from https://stackoverflow.com/a/35730328/5601796

VENV ?= .venv
KFP_TEKTON_RELEASE ?= v1.7.1
KFP_TEKTON_RELEASE ?= v1.8.0
export VIRTUAL_ENV := $(abspath ${VENV})
export PATH := ${VIRTUAL_ENV}/bin:${PATH}
DOCKER_REGISTRY ?= aipipeline
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ For more details about the project please follow this detailed [blog post](https
## Architecture

We are currently using [Kubeflow Pipelines 1.8.4](https://github.com/kubeflow/pipelines/releases/tag/1.8.4) and
[Tekton >= 0.50.0](https://github.com/tektoncd/pipeline/releases/tag/v0.50.0)
[Tekton >= 0.50.1](https://github.com/tektoncd/pipeline/releases/tag/v0.50.1)
for this project.

For [Kubeflow Pipelines 2.0.0](https://github.com/kubeflow/pipelines/releases/tag/2.0.0) and
Expand Down
2 changes: 1 addition & 1 deletion VERSION
Original file line number Diff line number Diff line change
@@ -1 +1 @@
1.7.1
1.8.0
2 changes: 1 addition & 1 deletion backend/third_party_licenses/apiserver.csv
Original file line number Diff line number Diff line change
Expand Up @@ -80,7 +80,7 @@ github.com/spf13/pflag,https://github.com/spf13/pflag/blob/v1.0.5/LICENSE,BSD-3-
github.com/spf13/viper,https://github.com/spf13/viper/blob/v1.10.1/LICENSE,MIT
github.com/stretchr/testify/assert,https://github.com/stretchr/testify/blob/v1.8.4/LICENSE,MIT
github.com/subosito/gotenv,https://github.com/subosito/gotenv/blob/v1.2.0/LICENSE,MIT
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.0/LICENSE,Apache-2.0
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.1/LICENSE,Apache-2.0
go.mongodb.org/mongo-driver,https://github.com/mongodb/mongo-go-driver/blob/v1.4.4/LICENSE,Apache-2.0
go.opencensus.io,https://github.com/census-instrumentation/opencensus-go/blob/v0.22.5/LICENSE,Apache-2.0
go.uber.org/atomic,https://github.com/uber-go/atomic/blob/v1.10.0/LICENSE.txt,MIT
Expand Down
2 changes: 1 addition & 1 deletion backend/third_party_licenses/cache_server.csv
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ github.com/prometheus/common/internal/bitbucket.org/ww/goautoneg,https://github.
github.com/prometheus/procfs,https://github.com/prometheus/procfs/blob/v0.9.0/LICENSE,Apache-2.0
github.com/prometheus/statsd_exporter/pkg/mapper,https://github.com/prometheus/statsd_exporter/blob/v0.21.0/LICENSE,Apache-2.0
github.com/spf13/pflag,https://github.com/spf13/pflag/blob/v1.0.5/LICENSE,BSD-3-Clause
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.0/LICENSE,Apache-2.0
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.1/LICENSE,Apache-2.0
go.mongodb.org/mongo-driver,https://github.com/mongodb/mongo-go-driver/blob/v1.4.4/LICENSE,Apache-2.0
go.opencensus.io,https://github.com/census-instrumentation/opencensus-go/blob/v0.22.5/LICENSE,Apache-2.0
go.uber.org/atomic,https://github.com/uber-go/atomic/blob/v1.10.0/LICENSE.txt,MIT
Expand Down
2 changes: 1 addition & 1 deletion backend/third_party_licenses/persistence_agent.csv
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,7 @@ github.com/spf13/pflag,https://github.com/spf13/pflag/blob/v1.0.5/LICENSE,BSD-3-
github.com/spf13/viper,https://github.com/spf13/viper/blob/v1.10.1/LICENSE,MIT
github.com/stretchr/testify/assert,https://github.com/stretchr/testify/blob/v1.8.4/LICENSE,MIT
github.com/subosito/gotenv,https://github.com/subosito/gotenv/blob/v1.2.0/LICENSE,MIT
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.0/LICENSE,Apache-2.0
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.1/LICENSE,Apache-2.0
go.mongodb.org/mongo-driver,https://github.com/mongodb/mongo-go-driver/blob/v1.4.4/LICENSE,Apache-2.0
go.opencensus.io,https://github.com/census-instrumentation/opencensus-go/blob/v0.22.5/LICENSE,Apache-2.0
go.uber.org/atomic,https://github.com/uber-go/atomic/blob/v1.10.0/LICENSE.txt,MIT
Expand Down
2 changes: 1 addition & 1 deletion backend/third_party_licenses/swf.csv
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ github.com/spf13/jwalterweatherman,https://github.com/spf13/jwalterweatherman/bl
github.com/spf13/pflag,https://github.com/spf13/pflag/blob/v1.0.5/LICENSE,BSD-3-Clause
github.com/spf13/viper,https://github.com/spf13/viper/blob/v1.10.1/LICENSE,MIT
github.com/subosito/gotenv,https://github.com/subosito/gotenv/blob/v1.2.0/LICENSE,MIT
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.0/LICENSE,Apache-2.0
github.com/tektoncd/pipeline/pkg,https://github.com/tektoncd/pipeline/blob/v0.50.1/LICENSE,Apache-2.0
go.mongodb.org/mongo-driver,https://github.com/mongodb/mongo-go-driver/blob/v1.4.4/LICENSE,Apache-2.0
go.opencensus.io,https://github.com/census-instrumentation/opencensus-go/blob/v0.22.5/LICENSE,Apache-2.0
go.uber.org/atomic,https://github.com/uber-go/atomic/blob/v1.10.0/LICENSE.txt,MIT
Expand Down
2 changes: 1 addition & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ require (
github.com/sirupsen/logrus v1.9.1
github.com/spf13/viper v1.10.1
github.com/stretchr/testify v1.8.4
github.com/tektoncd/pipeline v0.50.0
github.com/tektoncd/pipeline v0.50.1
github.com/tidwall/pretty v1.1.0 // indirect
go.uber.org/zap v1.24.0
golang.org/x/net v0.11.0
Expand Down
4 changes: 2 additions & 2 deletions go.sum

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

30 changes: 15 additions & 15 deletions guides/kfp_tekton_install.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@

## Installation Targets and Prerequisites

A Kubernetes cluster `v1.24` that has least 8 vCPU and 16 GB memory.
A Kubernetes cluster `v1.25` that has least 8 vCPU and 16 GB memory.

### IBM Cloud Kubernetes Service (IKS)

Expand All @@ -41,20 +41,21 @@ A Kubernetes cluster `v1.24` that has least 8 vCPU and 16 GB memory.

Each new KFP-Tekton version is based on the long-term support of the Tekton Pipeline version and the major release of the Openshift pipeline version. Below is the list of compatible KFP-Tekton version to the Tekton/Openshift pipelines version.

| KFP-Tekton Version | Tekton Pipeline Version | OpenShift Pipelines Version |
| -------- | ------- | ------- |
| 1.5.x | 0.41.x | 1.9 |
| 1.6.x | 0.44.x | 1.10 |
| 1.7.x | 0.47.x | 1.11 |
| KFP-Tekton Version | Tekton Pipeline Version | OpenShift Pipelines Version | Tekton Core API Version |
| -------- | ------- | ------- | ------- |
| 1.5.x | 0.41.x | 1.9 | V1beta1 |
| 1.6.x | 0.44.x | 1.10 | V1beta1 |
| 1.7.x | 0.47.x | 1.11 | V1beta1 |
| 1.8.x | 0.50.x | 1.12 | V1 |

## Standalone Kubeflow Pipelines with Tekton Backend Deployment

To install the standalone Kubeflow Pipelines with Tekton, run the following steps:

1. Install [Tekton v0.47.1](https://github.com/tektoncd/pipeline/blob/v0.47.1/docs/install.md#installing-tekton-pipelines-on-kubernetes) if you don't have Tekton pipelines on the cluster. Please be aware that Tekton custom task, loop, and recursion will not work if Tekton pipelines version is not v0.41.0+.
1. Install [Tekton v0.50.1](https://github.com/tektoncd/pipeline/blob/v0.50.1/docs/install.md#installing-tekton-pipelines-on-kubernetes) if you don't have Tekton pipelines on the cluster. Please be aware that Tekton custom task, loop, and recursion will not work if Tekton pipelines version is not v0.50.0+.

```shell
kubectl apply -f https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.47.1/release.yaml
kubectl apply -f https://storage.googleapis.com/tekton-releases/pipeline/previous/v0.50.1/release.yaml
```

2. Enable necessary Tekton configurations for kfp-tekton
Expand All @@ -65,15 +66,14 @@ To install the standalone Kubeflow Pipelines with Tekton, run the following step
-p '{"data":{"default-timeout-minutes": "0"}}'
```

3. Install Kubeflow Pipelines with Tekton backend (`kfp-tekton`) `v1.7.1` [custom resource definitions](https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/)(CRDs).
> Note: You can ignore the error `no matches for kind "Application" in version "app.k8s.io/v1beta1"` since it's a warning saying `application` CRD is not yet ready.
3. Install Kubeflow Pipelines with Tekton backend (`kfp-tekton`) `v1.8.0` [custom resource definitions](https://kubernetes.io/docs/concepts/extend-kubernetes/api-extension/custom-resources/)(CRDs).
```shell
kubectl apply --selector kubeflow/crd-install=true -f https://raw.githubusercontent.com/kubeflow/kfp-tekton/master/install/v1.7.1/kfp-tekton.yaml
kubectl apply --selector kubeflow/crd-install=true -f https://raw.githubusercontent.com/kubeflow/kfp-tekton/master/install/v1.8.0/kfp-tekton.yaml
```

4. Install Kubeflow Pipelines with Tekton backend (`kfp-tekton`) `v1.7.1` deployment
4. Install Kubeflow Pipelines with Tekton backend (`kfp-tekton`) `v1.8.0` deployment
```shell
kubectl apply -f https://raw.githubusercontent.com/kubeflow/kfp-tekton/master/install/v1.7.1/kfp-tekton.yaml
kubectl apply -f https://raw.githubusercontent.com/kubeflow/kfp-tekton/master/install/v1.8.0/kfp-tekton.yaml
```

5. Then, if you want to expose the Kubeflow Pipelines endpoint outside the cluster, run the following commands:
Expand All @@ -94,7 +94,7 @@ To install the standalone Kubeflow Pipelines with Tekton, run the following step

7. (OpenShift only) If you are running the standalone KFP-Tekton on OpenShift, apply the necessary security context constraint below
```shell
curl -L https://raw.githubusercontent.com/kubeflow/kfp-tekton/master/install/v1.7.1/kfp-tekton.yaml | yq 'del(.spec.template.spec.containers[].securityContext.runAsUser, .spec.template.spec.containers[].securityContext.runAsGroup)' | oc apply -f -
curl -L https://raw.githubusercontent.com/kubeflow/kfp-tekton/master/install/v1.8.0/kfp-tekton.yaml | yq 'del(.spec.template.spec.containers[].securityContext.runAsUser, .spec.template.spec.containers[].securityContext.runAsGroup)' | oc apply -f -
oc apply -k https://github.com/kubeflow/kfp-tekton//manifests/kustomize/third-party/openshift/standalone
oc adm policy add-scc-to-user anyuid -z tekton-pipelines-controller
oc adm policy add-scc-to-user anyuid -z tekton-pipelines-webhook
Expand Down Expand Up @@ -143,7 +143,7 @@ To install the standalone Kubeflow Pipelines with Openshift Pipelines, run the f

1. Follow the [Kubeflow install instructions](https://www.kubeflow.org/docs/ibm/deploy/install-kubeflow-on-iks/#kubeflow-installation)
to install the entire Kubeflow stack with `kfp-tekton`.
Kubeflow `v1.7.0` uses Tekton `v0.41.0` and `kfp-tekton` `v1.5.1`. <!-- TODO update-->
Kubeflow `v1.8.0` uses Tekton `v0.47.3` and `kfp-tekton` `v2.0.0` or `v1.7.1`. <!-- TODO update-->

2. Visit [KFP Tekton User Guide](/guides/kfp-user-guide) and start learning how to use Kubeflow pipeline.

Expand Down
Loading
Loading