Fix pipeline tests - don't set torch_dtype on non-torch pipelines#31809

amyeroberts wants to merge 1 commit intohuggingface:mainhuggingface/transformers:mainfrom

amyeroberts:fix-torch-dtype-pipeline-testsamyeroberts/transformers:fix-torch-dtype-pipeline-testsCopy head branch name to clipboard