Skip to content
Permalink

Comparing changes

This is a direct comparison between two commits made in this repository or its related repositories. View the default comparison for this range or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: wenet-e2e/wenet
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: aab5fdee5a03c0b58a140cd975c71c038da129cf
Choose a base ref
..
head repository: wenet-e2e/wenet
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: a13dedf5ad16fc98152d0a825c3c3158ac25890c
Choose a head ref
Showing with 2 additions and 2 deletions.
  1. +2 −2 wenet/text/bpe_tokenizer.py
4 changes: 2 additions & 2 deletions wenet/text/bpe_tokenizer.py
Original file line number Diff line number Diff line change
@@ -17,9 +17,9 @@ def __init__(
) -> None:
super().__init__(symbol_table, non_lang_syms, split_with_space,
connect_symbol, unk)
# NOTE(Mddct): multiprocessing.Process() issues
# see: https://github.com/espnet/espnet/blob/master/espnet2/text/sentencepiece_tokenizer.py#L19
self._model = bpe_model
# NOTE(Mddct): multiprocessing.Process() issues
# don't build sp here
self.bpe_model = None

def _build_sp(self):