Python Deep Learning Projects

What is TF-IDF?

TF-IDFs are a way to represent documents as feature vectors. But what are they? TF-IDFs can be understood as a modification of the raw term frequency (TF) and inverse document frequency (IDF). The TF is the count of how often a particular word occurs in a given document. The concept behind the TF-IDF is to downweight terms proportionally to the number of documents in which they occur. Here, the idea is that terms that occur in many different documents are likely to be unimportant, or don't contain any useful information for NLP tasks, such as document classification.