Skip to Main Content
Apache Spark Deep Learning Cookbook
book

Apache Spark Deep Learning Cookbook

by Ahmed Sherif, Amrith Ravindra, Michal Malohlava, Adnan Masood
July 2018
Intermediate to advanced content levelIntermediate to advanced
474 pages
13h 37m
English
Packt Publishing
Content preview from Apache Spark Deep Learning Cookbook

How it works...

The functionality is as follows:

  1. The t-SNE algorithm is a non-linear dimensionality reduction technique. Computers are easily able to interpret and process many dimensions during their computations. However, humans are only capable of visualizing two or three dimensions at a time. Therefore, these dimensionality reduction techniques come in very handy when trying to draw insights from data.

 

  1. On applying t-SNE to the 300-dimensional vectors, we are able to squash it into just two dimensions to plot it and view it.
  2. By specifying n_components as 2, we let the algorithm know that it has to squash the data into a two-dimensional space. Once this is done, we add all the squashed vectors into one giant matrix named all_word_vectors_matrix ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

Apache Spark for Data Science Cookbook

Apache Spark for Data Science Cookbook

Padma Priya Chitturi
Learning Apache Spark 2

Learning Apache Spark 2

Muhammad Asif Abbasi

Publisher Resources

ISBN: 9781788474221Supplemental Content