Make sure custom configs work with Transformers#15569

sgugger merged 2 commits intomasterhuggingface/transformers:masterfrom

custom_confighuggingface/transformers:custom_configCopy head branch name to clipboard