Skip to content

Set _tokenizer attribute in experimental trainers#5566

Merged
albertvillanova merged 20 commits into
huggingface:mainfrom
albertvillanova:set-tokenizer-attribute-exp
Apr 28, 2026
Merged

Set _tokenizer attribute in experimental trainers#5566
albertvillanova merged 20 commits into
huggingface:mainfrom
albertvillanova:set-tokenizer-attribute-exp

Use self._tokenizer in _prepare_dataset

ba22aad
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

2 errors
Tests (experimental)
succeeded Apr 28, 2026 in 9m 33s