Skip to content

Commit 92ca3ff

Browse files
committed
FIX train test split bug in Dataset class
1 parent 34aebbe commit 92ca3ff

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

helpers.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -128,7 +128,7 @@ def __new__(cls, tagfile, datafile, train_test_split=0.8, seed=112890):
128128
_keys = list(keys)
129129
if seed is not None: random.seed(seed)
130130
random.shuffle(_keys)
131-
split = int(0.8 * len(_keys))
131+
split = int(train_test_split * len(_keys))
132132
training_data = Subset(sentences, _keys[:split])
133133
testing_data = Subset(sentences, _keys[split:])
134134
stream = tuple(zip(chain(*word_sequences), chain(*tag_sequences)))

0 commit comments

Comments
 (0)