We experimentally evaluated bagging and six other randomization-based ensemble tree methods. Bagging uses randomization to
create multiple training sets. Other approaches, such as Randomized C4.5, apply randomization in selecting a test at a given
node of a tree. Then there are approaches, such as random forests and random subspaces, that apply randomization in the selection
of attributes to be used in building the tree. On the other hand boosting incrementally builds classifiers by focusing on
examples misclassified by existing classifiers. Experiments were performed on 34 publicly available data sets. While each
of the other six approaches has some strengths, we find that none of them is consistently more accurate than standard bagging
when tested for statistical significance.