Following is a list of benchmark datasets used in the majority of text categorization research:
- IMDB Movie Review dataset: This is a dataset for binary sentiment classification. It contains a set of 25,000 movie reviews for training, and 25,000 for testing. There is additional unlabeled data for use as well. This dataset is downloadable from http://ai.stanford.edu/~amaas/data/sentiment/.
- Reuters dataset: This dataset has 90 classes, 9,584 training documents and 3,744 testing documents. It's available as a part of the package nltk.corpus. The class distribution for the documents in this dataset is very skewed, with the two most frequent classes containing approximately 70% of all the documents. Even if we consider only ...