Skip to content

Commit

Permalink
Consolidate Kubeflow tests (kubeflow#2805)
Browse files Browse the repository at this point in the history
* Training operator  CICD improvements (kubeflow#2779)

* Add the networkpolicies

Signed-off-by: juliusvonkohout <[email protected]>

* rework the training operator tests

Signed-off-by: juliusvonkohout <[email protected]>

* fix the comments

Signed-off-by: juliusvonkohout <[email protected]>

* fix filename

Signed-off-by: juliusvonkohout <[email protected]>

* try to fix the permissions

Signed-off-by: juliusvonkohout <[email protected]>

* try to fix the permissions

Signed-off-by: juliusvonkohout <[email protected]>

* change to the user namespace

Signed-off-by: juliusvonkohout <[email protected]>

* update the image to rc.1

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

* fixes

Signed-off-by: juliusvonkohout <[email protected]>

---------

Signed-off-by: juliusvonkohout <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* create seperate file for install_KinD_create_KinD_cluster_install_kustomize.sh to avoid code repitition

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* make sh file executable

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* remove reduntant codes

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* combine kind, kuztomize and kind-cluster create sh files into one file

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix issues with combined file

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix configurations issues

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix linting issues in workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix trailing issues in workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix trailing issues in workflow file bentoml

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh executable and removed chmod command from the workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made modifications in workflow files

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* deleted redundant files from tests folder

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* Add kustomize installation file

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made install_kustomize.sh file executable

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* made a fix

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* fix issue with linting of YAML files (kubeflow#2825)

* fix issue with linting of YAML files

Signed-off-by: hansinikarunarathne <[email protected]>

* delete a file to check the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* Add the after checking the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* Add folders to yaml linting

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting issues

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting issues

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting changes

Signed-off-by: hansinikarunarathne <[email protected]>

* check linting functionality by chnaging different files

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file and check the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* made some fixes in linting YAML file and check the functionality

Signed-off-by: hansinikarunarathne <[email protected]>

* Add github, hack and tests folders also for linting

Signed-off-by: hansinikarunarathne <[email protected]>

* Check functionality by deleting sh from hack and yaml file common

Signed-off-by: hansinikarunarathne <[email protected]>

* Added deleted files

Signed-off-by: hansinikarunarathne <[email protected]>

---------

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* Expose Ray and Seldon to example kustomization.yaml file (kubeflow#2834)

* Expose Ray and Seldon to example kustomization.yaml file

Signed-off-by: hansinikarunarathne <[email protected]>

* Add internal documentations for ray and seldon

Signed-off-by: hansinikarunarathne <[email protected]>

---------

Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* Increase the time out of notebook and katib test

Signed-off-by: hansinikarunarathne <[email protected]>

* increase the timout time

Signed-off-by: hansinikarunarathne <[email protected]>

* increase timeout of the create pipeline Run from Kubeflow Notebook to 2400s

Signed-off-by: hansinikarunarathne <[email protected]>

* Add code to calculate time taken to pull a docker image

Signed-off-by: hansinikarunarathne <[email protected]>

* fix syntax error in yaml file

Signed-off-by: hansinikarunarathne <[email protected]>

* increase pipeline time

Signed-off-by: hansinikarunarathne <[email protected]>

* remove one step in action

Signed-off-by: hansinikarunarathne <[email protected]>

* Added tests to tests/gh-actions to enable baseline and restricted PSS (kubeflow#2819)

* Patched PSS labels to multi_tenancy

Signed-off-by: biswajit-9776 <[email protected]>

* Added script in gh-actions to patch PSS/static/baseline/pacthes

Signed-off-by: biswajit-9776 <[email protected]>

* Added PSS scripts for both baseline and restricted labels of static namespaces and renamed directories

Signed-off-by: biswajit-9776 <[email protected]>

* Added tests to enable PSS in gh-actions

Signed-off-by: biswajit-9776 <[email protected]>

* Added workflow test for PSS labels

Signed-off-by: biswajit-9776 <[email protected]>

* Fixed indentation

Signed-off-by: biswajit-9776 <[email protected]>

---------

Signed-off-by: biswajit-9776 <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>

* add kind cluster step into pss test yaml file

Signed-off-by: hansinikarunarathne <[email protected]>

* change time pot time

Signed-off-by: hansinikarunarathne <[email protected]>

---------

Signed-off-by: juliusvonkohout <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
Signed-off-by: biswajit-9776 <[email protected]>
Co-authored-by: Julius von Kohout <[email protected]>
Co-authored-by: biswajit-9776 <[email protected]>
Signed-off-by: hansinikarunarathne <[email protected]>
  • Loading branch information
3 people committed Aug 26, 2024
1 parent 357925b commit a4b374c
Show file tree
Hide file tree
Showing 27 changed files with 143 additions and 297 deletions.
14 changes: 3 additions & 11 deletions .github/workflows/admission_webhook_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,9 @@ name: Build & Apply PodDefaults manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/admission_webhook_test.yaml
- apps/admission-webhook/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -18,14 +16,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/bentoml_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,8 @@ name: Build & Apply BentoML Yatai Stack manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/bentoml_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
- contrib/bentoml/**
Expand All @@ -17,14 +15,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install cert-manager
run: ./tests/gh-actions/install_cert_manager.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/centraldashboard_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,9 @@ name: Build & Apply CentralDashboard manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/centraldashboard_test.yaml
- apps/centraldashboard/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh

jobs:
Expand All @@ -16,14 +14,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/dex_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,9 @@ name: Build & Apply Dex manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/dex_test.yaml
- common/dex/base/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh

jobs:
Expand All @@ -16,14 +14,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/jupyter_web_application_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,9 @@ name: Build & Apply JWA manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/jupyter_web_application_test.yaml
- apps/jupyter/jupyter-web-app/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh

jobs:
Expand All @@ -16,14 +14,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
16 changes: 4 additions & 12 deletions .github/workflows/katib_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,11 +2,9 @@ name: Build & Apply Katib manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/katib_test.yaml
- apps/katib/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -18,14 +16,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down Expand Up @@ -57,7 +49,7 @@ jobs:
kubectl wait --for=condition=Running experiments.kubeflow.org -n kubeflow-user --all --timeout 300s
echo "Waiting for all Trials to become Succeeded..."
kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 300s
kubectl wait --for=condition=Succeeded trials.kubeflow.org -n kubeflow-user --all --timeout 1200s
echo "Waiting for the Experiment to become Succeeded..."
kubectl wait --for=condition=Succeeded experiments.kubeflow.org -n kubeflow-user --all --timeout 300s
14 changes: 3 additions & 11 deletions .github/workflows/kserve_cni_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,8 @@ name: Build & Apply KServe manifests in KinD, using istio CNI
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/kserve_cni_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- common/istio-cni-1-22/**
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -20,14 +18,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
Expand Down
16 changes: 4 additions & 12 deletions .github/workflows/kserve_m2m_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,10 @@ name: Deploy and test KServe with m2m auth in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/kserve_m2m_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- contrib/kserve/**
- common/oauth2-proxy/**
- common/oidc-client/oauth2-proxy/**
- common/istio*/**
- tests/gh-actions/install_istio_with_ext_auth.sh*
- tests/gh-actions/install_cert_manager.sh
Expand All @@ -23,18 +21,12 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install kubectl
run: ./tests/gh-actions/install_kubectl.sh

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/kserve_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,8 @@ name: Build & Apply KServe manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/kserve_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- contrib/kserve/**
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -20,14 +18,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -
Expand Down
14 changes: 3 additions & 11 deletions .github/workflows/metacontroller_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,8 @@ name: Build & Apply contrib/metacontroller in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/metacontroller_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- contrib/metacontroller/**
- tests/gh-actions/install_cert_manager.sh
- common/cert-manager/**
Expand All @@ -19,14 +17,8 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config ./tests/gh-actions/kind-cluster.yaml

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install Istio
run: ./tests/gh-actions/install_istio.sh
Expand Down
13 changes: 3 additions & 10 deletions .github/workflows/model_registry_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,9 +4,8 @@ name: Deploy and test Kubeflow Model Registry
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- apps/model-registry/upstream/**
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kustomize.sh
- tests/gh-actions/install_istio.sh
- common/istio*/**

Expand All @@ -17,18 +16,12 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install kubectl
run: ./tests/gh-actions/install_kubectl.sh

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

Expand Down
16 changes: 4 additions & 12 deletions .github/workflows/notebook_controller_m2m_test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,12 +2,10 @@ name: Test Notebook Controller with m2m auth manifests in KinD
on:
pull_request:
paths:
- tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh
- .github/workflows/notebook_controller_m2m_test.yaml
- tests/gh-actions/kind-cluster.yaml
- tests/gh-actions/install_kind.sh
- tests/gh-actions/install_kustomize.sh
- apps/jupyter/**
- common/oauth2-proxy/**
- common/oidc-client/oauth2-proxy/**
- common/istio*/**
- tests/gh-actions/install_istio_with_ext_auth.sh*
- tests/gh-actions/install_multi_tenancy.sh
Expand All @@ -19,18 +17,12 @@ jobs:
- name: Checkout
uses: actions/checkout@v4

- name: Install KinD
run: ./tests/gh-actions/install_kind.sh

- name: Create KinD Cluster
run: kind create cluster --config tests/gh-actions/kind-cluster.yaml
- name: Install KinD, Create KinD cluster and Install kustomize
run: ./tests/gh-actions/install_KinD_create_KinD_cluster_install_kustomize.sh

- name: Install kubectl
run: ./tests/gh-actions/install_kubectl.sh

- name: Install kustomize
run: ./tests/gh-actions/install_kustomize.sh

- name: Create kubeflow namespace
run: kustomize build common/kubeflow-namespace/base | kubectl apply -f -

Expand Down
Loading

0 comments on commit a4b374c

Please sign in to comment.