Volume 18, Number 3, 311-322, DOI: 10.1023/A:1023202221875

On Machine Learning Methods for Chinese Document Categorization

Ji He, Ah-Hwee Tan and Chew-Lim Tan

From the issue entitled "Special Issue on Text and Web Mining"

View Related Documents

Abstract

This paper reports our comparative evaluation of three machine learning methods, namely k Nearest Neighbor (kNN), Support Vector Machines (SVM), and Adaptive Resonance Associative Map (ARAM) for Chinese document categorization. Based on two Chinese corpora, a series of controlled experiments evaluated their learning capabilities and efficiency in mining text classification knowledge. Benchmark experiments showed that their predictive performance were roughly comparable, especially on clean and well organized data sets. While kNN and ARAM yield better performances than SVM on small and clean data sets, SVM and ARAM significantly outperformed kNN on noisy data. Comparing efficiency, kNN was notably more costly in terms of time and memory than the other two methods. SVM is highly efficient in learning from well organized samples of moderate size, although on relatively large and noisy data the efficiency of SVM and ARAM are comparable.

text categorization - machine learning - comparative experiments

Fulltext Preview

Image of the first page of the fulltext document