Welcome!
To use the personalized features of this site, please log in or register.
If you have forgotten your username or password, we can help.
My Menu
Saved Items

Toward Drawing an Atlas of Hypothesis Classes: Approximating a Hypothesis via Another Hypothesis Model

Osamu MaruyamaContact Information, Takayoshi ShoudaiContact Information and Satoru Miyano9, 10 Contact Information

(7)  Faculty of Mathematics, Kyushu University, Japan
(8)  Department of Informatics, Kyushu University, Japan
(9)  Institute of Medical Science, University of Tokyo, Japan
(10)  Institute for Chemical Research, Kyoto University, Japan
Abstract
Computational knowledge discovery can be considered to be a complicated human activity concerned with searching for something new from data with computer systems. The optimization of theentire process of computational knowledge discovery is a big challenge in computer science. If we had an atlas of hypothesis classes which describes prior and basic knowledge on relative relationship between the hypothesis classes, it would be helpful in selecting hypothesis classes to be searched in discovery processes. In this paper, to give a foundation for an atlas of various classes of hypotheses, we have defined a measure of approximation of a hypothesis class C 1 to another class C 2. The hypotheses we consider here are restricted to m-ary Boolean functions. For 0 ≤ ∈ ≤ 1, we say that C 1 is (1-∈)-approximated to C 2 if, for every distribution Dover (0, 1)m, and for each hypothesis h 1C 1, there exists a hypothesis h 2C 2 such that, with the probability at most ∈, we have h 1 x) ≠ h 2 x) where x ∈ { 0, 1 } m is drawn randomly and independently according to D. Thus, we can use the approximation ratio of C 1 to C 2 as an index of how similar C 1 is to C 2. We discuss lower bounds of the approximation ratios among representative classes of hypotheses like decision lists, decision trees, linear discriminant functions and so on. This prior knowledge would come in useful when selecting hypothesis classes in the initial stage and the sequential stages involved in the entire discovery process.

Contact Information Osamu Maruyama
Email: om@math.kyushu-u.ac.jp

Contact Information Takayoshi Shoudai
Email: shoudai@i.kyushu-u.ac.jp

Contact Information Satoru Miyano
Email: miyano@ims.u-tokyo.ac.jp
Fulltext Preview (Small, Large)
Image of the first page of the fulltext

References secured to subscribers.



Export this chapter
Export this chapter as RIS | Text
 
Remote Address: 38.107.191.109 • Server: mpweb24
HTTP User Agent: CCBot/1.0 (+http://www.commoncrawl.org/bot.html)