fix assert pad >= 0 failed when inter_size is not a multiple of group…#2740