[rllib] Fix AlgorithmConfig validation when using OfflinePreLearner#55416

johnPertoft wants to merge 2 commits intoray-project:masterray-project/ray:masterfrom

johnPertoft:masterjohnPertoft/ray:masterCopy head branch name to clipboard