Handle illegal character in benchmark configs filename (#7461)

Handle illegal character in benchmark configs filename (#7461) #27210