sum() is replaced by itertools.chain.from_iterable()#1831

Merged

thomwolf merged 1 commit intohuggingface:masterfrom

iedmrc:gpt2-tokenization-sum-func-replacement

Nov 14, 2019

Commits on Nov 14, 2019

sum() is the leanest method to flatten a string list, so it's been replaced by itertools.chain.from_iterable()
iedmrc
committed