The use of different discretization techniques can be expected to affect the classification bias and variance of naive-Bayes
classifiers. We call such an effect discretization bias and variance. Proportional k-interval discretization (PKID) tunes discretization bias and variance by adjusting discretized interval size
and number proportional to the number of training instances. Theoretical analysis suggests that this is desirable for naive-Bayes
classifiers. However PKID is sub-optimal when learning from training data of small size. We argue that this is because PKID
equally weighs bias reduction and variance reduction. But for small data, variance reduction can contribute more to lower
learning error and thus should be given greater weight than bias reduction. Accordingly we propose weighted proportional k-interval
discretization (WPKID), which establishes a more suitable bias and variance trade-off for small data while allowing additional
training data to be used to reduce both bias and variance. Our experiments demonstrate that for naive-Bayes classifiers, WPKID
improves upon PKID for smaller datasets with significant frequency; and WPKID delivers lower classification error significantly
more often than not in comparison to three other leading alternative discretization techniques studied.
’Small ‘is a relative rather than an absolute term. Of necessity, we here utilize an arbitrary definition, deeming datasets
with size no larger than 1000 as ’smaller‘ datasets, otherwise as ’larger‘ datasets.