Machine Learning with Spark - Second Edition
by Rajdeep Dua, Brian O'Neill, Stephen Boesch, Manpreet Singh Ghotra, Nick Pentreath
Word2Vector
The Word2Vec tools take text data as input and produce the word vectors as output. This tool constructs a vocabulary from the training text data and learns vector representation of words. The resulting word vector file can be used as features for many natural language processing and machine learning applications.
The easiest way to investigate the learned representations is to find the closest words for a user-specified word.
Word2Vec implementation in Apache Spark computes distributed vector representation of words. Apache Spark's implementation is a more scalable approach as compared to single machine Word2Vec implementations provided by Google).
(https://code.google.com/archive/p/word2vec/)
Word2Vec can be implemented using ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access