Skip to Main Content
fastText Quick Start Guide
book

fastText Quick Start Guide

by Joydeep Bhattacharjee
July 2018
Intermediate to advanced content levelIntermediate to advanced
194 pages
5h 22m
English
Packt Publishing
Content preview from fastText Quick Start Guide

Hierarchical softmax architecture

Finding the softmax is computationally quite expensive and prohibitive for a large corpus as this means that we not only have to find the score for the text with the label but the scores for the text with all the labels. So for n text and m labels, this scales with worst case performance of O(n2), which you know is not good.

Also, softmax and other similar methods for finding the probabilities do not take into account the semantically meaningful organization of classes. A classifier should know that classifying a dog as a submarine should have a higher penalty than a dog as a wolf. An intuition that we may have is that the target labels are probably not flat but rather a tree.

So now we have k classes that ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Start your free trial

You might also like

WebAssembly: The Definitive Guide

WebAssembly: The Definitive Guide

Brian Sletten
Spark: The Definitive Guide

Spark: The Definitive Guide

Bill Chambers, Matei Zaharia
Learning Go

Learning Go

Jon Bodner

Publisher Resources

ISBN: 9781789130997Supplemental Content