Volume 25, Number 1, 23-50, DOI: 10.1023/A:1018344122010

Using the Minimum Description Length Principle to Infer Reduced Ordered Decision Graphs

Arlindo L. Oliveira and Alberto Sangiovanni-Vincentelli

View Related Documents

Abstract

We propose an algorithm for the inference of decision graphs from a set of labeled instances. In particular, we propose to infer decision graphs where the variables can only be tested in accordance with a given order and no redundant nodes exist. This type of graphs, reduced ordered decision graphs, can be used as canonical representations of Boolean functions and can be manipulated using algorithms developed for that purpose. This work proposes a local optimization algorithm that generates compact decision graphs by performing local changes in an existing graph until a minimum is reached. The algorithm uses Rissanenlsquos minimum description length principle to control the tradeoff between accuracy in the training set and complexity of the description. Techniques for the selection of the initial decision graph and for the selection of an appropriate ordering of the variables are also presented. Experimental results obtained using this algorithm in two sets of examples are presented and analyzed.

Inductive learning - MDL principle - decision trees

Fulltext Preview

Image of the first page of the fulltext document