word2vec-pytorch

Implementation of the word2vec algorithms (Skip-gram and CBOW, both with subsampling and negative sampling) in PyTorch. The purpose of this project is to aid my understanding of word2vec, hence the verbosity of comments in the code.

References

• Mikolov et al.: Distributed representations of words and phrases and their compositionality
• Mikolov et al.: Efficient estimation of word representations in vector space
• Jurafsky & Martin: Speech and Language Processing, Chapter 6
• dthiagarajan's implementation
• jojonki's implementation