Mount credentials into local execution docker container

[joekitsmith]

I'm using kfp to run a pipeline in GCP Vertex AI. I have an e2e test setup that will deploy the pipeline and check the outputs but this takes a long time to run. I want to be able to run my pipeline locally to check everything is configured correctly.

I have been trying to use kfp local execution with DockerRunner. I am using container components so this would work nicely.

However, my component requires GCP credentials to access secrets that are used to retrieve data from a third party application. These credentials are not present in the local docker container that is created and so retrieval of the secrets fails.

Is there any way I can mount my local GCP credentials into the docker container via kfp?

[carlthome]

Also wondering this!

I'm trying to develop a Google Cloud Secret Manager component and want to mount my developer credentials into the local container.

[gleb-lukicov]

+1 I would also like to know a solution for this!

[dshkliarenko]

A workaround which works for me is to monkey-patch DockerTaskHandler.get_volumes_to_mount adding mount mapping for credentials path, and then set env variable pointing to that path inside the component which requires the credentials.

[EladProject]

I'm using pipeline_root to pass a .env file to the component (a terrible solution, I know). Maybe you can use it to pass the credentials json.