Volume 3, Number 4, 319-342, DOI: 10.1007/BF00116837

An empirical comparison of selection measures for decision-tree induction

John Mingers

View Related Documents

Abstract

One approach to induction is to develop a decision tree from a set of examples. When used with noisy rather than deterministic data, the method involve-three main stages—creating a complete tree able to classify all the examples, pruning this tree to give statistical reliability, and processing the pruned tree to improve understandability. This paper is concerned with the first stage — tree creation which relies on a measure for ldquogoodness of split,rdquo that is, how well the attributes discriminate between classes. Some problems encountered at this stage are missing data and multi-valued attributes. The paper considers a number of different measures and experimentally examines their behavior in four domains. The results show that the choice of measure affects the size of a tree but not its accuracy, which remains the same even when attributes are selected randomly.

Keywords  Decision trees - knowledge acquisition - induction - noisy data

Fulltext Preview

Image of the first page of the fulltext document