About Multiprocessing

[JIANAN17]

Hi, I met some difficulties about multiprocessing. When the num_processes is changed to more than 1, the assignment of tasks among the workers has something wrong. Do you have any idea about this issue?

[eduOS]

I don't think this is a good question since there are no details in it.

[JIANAN17]

I don't think this is a good question since there are no details in it.

I'm sorry for the unclear description. The problem is that if the num_processes is set as more than 1, the training process won't stop when the trained word percent (global_word_count.value/vocab.word_count) is 100%. In normal circumstances, the training is finished when it is 100%.

[luckystar1992]

@JIANAN17 I think this bug is caused by the readline() code, I think your corpus is contains only one line. For more information, please chat in my issue #9 (comment)