Add test friendly manifests

[Jeffwan]

Resolve #302

1. We can use kubectl apply -k manifests/ to deploy pytorch-operator now.
2. Images can be changed by following commands.

kustomize edit set image gcr.io/kubeflow-images-public/pytorch-operator=${REGISTRY}/pytorch-operator:$(TAG)

This will be used to deprecate https://github.com/kubeflow/pytorch-operator/blob/master/scripts/setup-kubeflow.sh later.

test scripts will be in separate PR along with other changes

[k8s-ci-robot]

@Jeffwan: The following test failed, say /retest to rerun all failed tests:

Test name	Commit	Details	Rerun command
kubeflow-pytorch-operator-presubmit	b2becd6	link	/test kubeflow-pytorch-operator-presubmit

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[Jeffwan]

/cc @johnugeorge @gaocegege

Let's merge some pending PRs.

[andreyvelich]

Maybe we deploy latest tag for controller in pytorch-operator repo by default?
What do you think?

[Jeffwan]

make sense. I will make the change.

[Jeffwan]

Change to latest

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: Jeffwan
To complete the pull request process, please assign johnugeorge after the PR has been reviewed.
You can assign the PR to them by writing /assign @johnugeorge in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[coveralls]

Coverage remained the same at 64.11% when pulling c7b3709 on Jeffwan:test_friendly_manifest into 3ae9808 on kubeflow:master.

[andreyvelich]

Thanks @Jeffwan!
@johnugeorge Do we need to add podgroup.yaml to the Kustomize manifests?

[aws-kf-ci-bot]

@Jeffwan: The following test failed, say /retest to rerun all failed tests:

Test name	Commit	Details	Rerun command
kubeflow-pytorch-operator-presubmit	c7b3709	link	/test kubeflow-pytorch-operator-presubmit

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

[Jeffwan]

this #305 already include the changes. I will close this PR