NATCAT: Weakly Supervised Text Classification with Naturally Annotated Resources

Zewei ChuKarl StratosKevin Gimpel.


We describe NatCat, a large-scale resource for text classification constructed from three data sources: Wikipedia, Stack Exchange, and Reddit. NatCat consists of document-category pairs derived from manual curation that occurs naturally within online communities. To demonstrate its usefulness, we build general purpose text classifiers by training on NatCat and evaluate them on a suite of 11 text classification tasks (CatEval), reporting large improvements compared to prior work. We benchmark different modeling choices and resource combinations and show how tasks benefit from particular NatCat data sources.


title={{NATCAT}: Weakly Supervised Text Classification with Naturally Annotated Resources},
author={Zewei Chu and Karl Stratos and Kevin Gimpel},
booktitle={3rd Conference on Automated Knowledge Base Construction},