Lecture Notes in Computer Science, 2009, Volume 5931/2009, 674-679, DOI: 10.1007/978-3-642-10665-1_71

Parallel K-Means Clustering Based on MapReduce

Weizhong Zhao, Huifang Ma and Qing He

View Related Documents

Abstract

Data clustering has been received considerable attention in many applications, such as data mining, document retrieval, image segmentation and pattern classification. The enlarging volumes of information emerging by the progress of technology, makes clustering of very large scale of data a challenging task. In order to deal with the problem, many researchers try to design efficient parallel clustering algorithms. In this paper, we propose a parallel k-means clustering algorithm based on MapReduce, which is a simple yet powerful parallel programming technique. The experimental results demonstrate that the proposed algorithm can scale well and efficiently process large datasets on commodity hardware.

Keywords  Data mining - Parallel clustering -  K-means - Hadoop - MapReduce

Fulltext Preview

Image of the first page of the fulltext document