Use CLIP model config to set some kwargs for components#16609

ydshieh merged 3 commits intohuggingface:mainhuggingface/transformers:mainfrom

ydshieh:fix_clip_pt_tf_outputsydshieh/transformers:fix_clip_pt_tf_outputsCopy head branch name to clipboard