[bug] Side effect in Trial controller spawnMetricsCollector

[gaocegege]

/kind bug

Run trial controller and create a trial, the metrics collector will be created multiple times. We do not check if the resource is created in the cluster. Thus it will return an error and run the endless reconcile loop

/assign

Anything else you would like to add:
[Miscellaneous information that will assist in solving the issue.]

Environment:

• Kubeflow version:
• Minikube version:
• Kubernetes version: (use kubectl version):
• OS (e.g. from /etc/os-release):